-- Logs begin at Tue 2022-09-27 09:07:44 UTC, end at Tue 2022-09-27 10:06:53 UTC. -- Sep 27 09:37:39.349791 dv-osbrick-master-4-ceph systemd[1]: Starting Devstack devstack@keystone.service... Sep 27 09:37:39.360214 dv-osbrick-master-4-ceph devstack@keystone.service[99827]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 27 09:37:39.362876 dv-osbrick-master-4-ceph devstack@keystone.service[99827]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 27 09:37:39 2022] *** Sep 27 09:37:39.362876 dv-osbrick-master-4-ceph devstack@keystone.service[99827]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 27 09:37:39.362876 dv-osbrick-master-4-ceph devstack@keystone.service[99827]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 27 09:37:39.362876 dv-osbrick-master-4-ceph devstack@keystone.service[99827]: nodename: dv-osbrick-master-4-ceph Sep 27 09:37:39.362876 dv-osbrick-master-4-ceph devstack@keystone.service[99827]: machine: x86_64 Sep 27 09:37:39.362876 dv-osbrick-master-4-ceph devstack@keystone.service[99827]: clock source: unix Sep 27 09:37:39.362876 dv-osbrick-master-4-ceph devstack@keystone.service[99827]: pcre jit disabled Sep 27 09:37:39.362876 dv-osbrick-master-4-ceph devstack@keystone.service[99827]: detected number of CPU cores: 4 Sep 27 09:37:39.362876 dv-osbrick-master-4-ceph devstack@keystone.service[99827]: current working directory: / Sep 27 09:37:39.362876 dv-osbrick-master-4-ceph devstack@keystone.service[99827]: detected binary path: /usr/bin/uwsgi-core Sep 27 09:37:39.362876 dv-osbrick-master-4-ceph devstack@keystone.service[99827]: your processes number limit is 47680 Sep 27 09:37:39.362876 dv-osbrick-master-4-ceph devstack@keystone.service[99827]: your memory page size is 4096 bytes Sep 27 09:37:39.362876 dv-osbrick-master-4-ceph devstack@keystone.service[99827]: detected max file descriptor number: 2048 Sep 27 09:37:39.362876 dv-osbrick-master-4-ceph devstack@keystone.service[99827]: lock engine: pthread robust mutexes Sep 27 09:37:39.363694 dv-osbrick-master-4-ceph devstack@keystone.service[99827]: thunder lock: enabled Sep 27 09:37:39.363694 dv-osbrick-master-4-ceph devstack@keystone.service[99827]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 27 09:37:39.363694 dv-osbrick-master-4-ceph devstack@keystone.service[99827]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 27 09:37:39.407084 dv-osbrick-master-4-ceph devstack@keystone.service[99827]: Python main interpreter initialized at 0x55f60c1e19c0 Sep 27 09:37:39.407084 dv-osbrick-master-4-ceph devstack@keystone.service[99827]: python threads support enabled Sep 27 09:37:39.407084 dv-osbrick-master-4-ceph devstack@keystone.service[99827]: your server socket listen backlog is limited to 100 connections Sep 27 09:37:39.407084 dv-osbrick-master-4-ceph devstack@keystone.service[99827]: your mercy for graceful operations on workers is 90 seconds Sep 27 09:37:39.407487 dv-osbrick-master-4-ceph devstack@keystone.service[99827]: mapped 403077 bytes (393 KB) for 2 cores Sep 27 09:37:39.407487 dv-osbrick-master-4-ceph devstack@keystone.service[99827]: *** Operational MODE: preforking *** Sep 27 09:37:39.407779 dv-osbrick-master-4-ceph devstack@keystone.service[99827]: *** uWSGI is running in multiple interpreter mode *** Sep 27 09:37:39.407779 dv-osbrick-master-4-ceph devstack@keystone.service[99827]: spawned uWSGI master process (pid: 99827) Sep 27 09:37:39.408010 dv-osbrick-master-4-ceph systemd[1]: Started Devstack devstack@keystone.service. Sep 27 09:37:39.408622 dv-osbrick-master-4-ceph devstack@keystone.service[99827]: spawned uWSGI worker 1 (pid: 99838, cores: 1) Sep 27 09:37:39.410408 dv-osbrick-master-4-ceph devstack@keystone.service[99827]: spawned uWSGI worker 2 (pid: 99839, cores: 1) Sep 27 09:37:39.410408 dv-osbrick-master-4-ceph devstack@keystone.service[99827]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 27 09:37:44.080878 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 09:37:44.080878 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: from cryptography.utils import int_from_bytes Sep 27 09:37:44.081737 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 09:37:44.081737 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: from cryptography.utils import int_from_bytes Sep 27 09:37:44.086662 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 09:37:44.086662 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: from cryptography.utils import int_from_bytes Sep 27 09:37:44.087238 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 09:37:44.087238 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: from cryptography.utils import int_from_bytes Sep 27 09:37:44.131010 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 27 09:37:44.131234 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 27 09:37:44.131386 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] command line args: [] {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 27 09:37:44.131747 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 27 09:37:44.131931 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ================================================================================ {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 27 09:37:44.132207 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] admin_token = **** {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.132450 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] config_dir = [] {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.132608 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.132809 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] config_source = [] {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.132952 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] debug = True {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.133151 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.134400 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.134400 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] insecure_debug = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.134400 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.134400 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.134400 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] list_limit = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.134697 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] log_config_append = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.134697 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.134837 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] log_dir = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.135041 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] log_file = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.135239 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.135486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.135728 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.135962 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.136048 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 27 09:37:44.136128 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.136189 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 27 09:37:44.136342 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.136492 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] command line args: [] {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 27 09:37:44.136570 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.136632 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 27 09:37:44.136758 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ================================================================================ {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 27 09:37:44.136918 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.137032 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.137127 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] admin_token = **** {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.137199 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.137263 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] config_dir = [] {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.137390 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.137467 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.137562 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] config_source = [] {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.137659 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.137740 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] debug = True {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.137952 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.138068 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.138188 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.138294 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] notification_format = cadf {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.138366 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] insecure_debug = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.138448 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.138590 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.138859 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.139007 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.139093 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] list_limit = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.139175 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] publish_errors = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.139243 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] log_config_append = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.139416 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.139495 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.139601 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] log_dir = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.139681 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.139752 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] log_file = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.139816 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.139983 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.140107 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.140204 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.140281 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.140447 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.140531 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] standard_threads = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.140690 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.140768 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] strict_password_check = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.140879 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.140961 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.141039 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.141110 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] use_eventlog = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.141240 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] use_journal = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.141323 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.141400 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] use_json = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.141479 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.141556 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] use_stderr = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.141703 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.141780 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] use_syslog = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.141931 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.142023 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] watch_log_file = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.142160 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.142251 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.142388 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.142464 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.142631 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.142709 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.142893 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] notification_format = cadf {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.142981 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.143162 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.143276 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.143410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.143623 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.143782 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.143858 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.143964 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] publish_errors = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.144081 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.144223 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.144322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.144399 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.144569 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.144657 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.144799 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.144903 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.145026 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.145132 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.145254 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.145362 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] standard_threads = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.145463 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] strict_password_check = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.145569 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.145752 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.145865 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.145943 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] use_eventlog = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.146071 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.146147 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] use_journal = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.146282 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] use_json = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.146355 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.146467 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] use_stderr = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.146540 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] use_syslog = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.146615 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.146721 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] watch_log_file = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 09:37:44.146820 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.147037 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.147122 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.147404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.147714 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.147795 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.147966 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.148066 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.148211 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.148310 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.148440 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.148562 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.148666 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.148802 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.148884 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.149051 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.149202 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.149276 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.149345 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.149522 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.149599 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.149769 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.149858 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.150016 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.150102 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.150249 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.150328 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.150488 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.150573 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.150718 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.150821 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.150984 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.151070 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.151211 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.151297 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.151447 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.151524 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.151677 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.151760 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.151901 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.151978 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.152126 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.152209 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.152351 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.152428 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.152577 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.152661 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.152809 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.152892 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.153052 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.153130 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.153277 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.153361 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.153508 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.153586 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.153734 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.153810 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.153965 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.154043 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.154195 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.154271 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.154433 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.154515 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.154662 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.154741 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.154902 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.154980 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.155132 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.155207 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.155360 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.155437 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.155591 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.155668 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.155822 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.155900 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.156046 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.156124 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.156278 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.156354 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.156505 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.156585 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.156734 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.156811 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.156958 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.157045 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.157188 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.157263 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.157417 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.157494 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.157642 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.157716 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.157871 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.157978 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.158102 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.158181 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.158328 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.158410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.158561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.158645 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.158807 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.158893 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.159043 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.159121 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.159278 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.159354 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.159513 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.159599 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.160128 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.160227 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.160322 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.160400 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.enabled = True {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.160554 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.160639 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.160785 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.160862 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.161021 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.161098 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.161253 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.161342 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.161483 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.161559 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.161719 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.161795 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.161950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.162035 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.162177 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.162254 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.162406 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.162490 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.162720 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.162897 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.163028 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.163436 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.163524 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.163682 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.163760 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.163920 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.163997 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.164152 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.164235 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.164390 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.164468 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.164623 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.164701 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.164852 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.164930 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.165083 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.165168 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.165311 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.165389 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.165535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.165612 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.165760 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.165837 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.165991 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.166070 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.enabled = True {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.166214 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.166291 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.166446 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.166522 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.166670 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.166743 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.166925 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.167004 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.167157 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.167235 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.167395 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.167482 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.167630 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.167710 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.167862 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.167939 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.168084 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] auth.external = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.168160 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.168309 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] auth.mapped = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.168389 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.168564 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.168641 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.168803 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.168888 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.169025 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] auth.password = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.169102 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.169249 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] auth.token = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.169327 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.169481 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.169567 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.169711 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] catalog.caching = True {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.169789 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.169945 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.170032 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.170168 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.170256 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.170399 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.170477 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.170627 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.170715 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.170961 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.171043 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.171127 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] credential.caching = True {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.171208 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.171301 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.171398 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] credential.driver = sql {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.171527 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.171605 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.171763 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.171850 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.172080 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.172211 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.172287 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.172357 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.172456 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.172548 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.172699 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.172813 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.172942 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.173066 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.173174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.173263 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.173400 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] auth.external = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.173477 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.173628 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] auth.mapped = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.173707 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.173916 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.174000 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.174145 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.174224 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.174372 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] auth.password = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.174450 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.174601 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] auth.token = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.174688 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.174861 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.174942 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] federation.caching = True {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.175093 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.175183 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] catalog.caching = True {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.175333 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.175419 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] federation.driver = sql {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.175561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.175640 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.175782 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.175859 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.176023 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.176110 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.176247 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.176330 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.176480 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] credential.caching = True {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.176558 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.176707 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.176795 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] credential.driver = sql {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.176953 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.177030 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.177180 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.177257 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.177420 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.177506 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.177647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] identity.caching = True {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.177725 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.177877 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.177955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.178117 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.178201 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.178432 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.178645 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.178888 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.179132 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] identity.driver = sql {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.179325 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.179449 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.179650 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.179765 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.179848 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.179909 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.180073 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.180162 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.180302 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.180370 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.180526 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.180605 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.180808 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.180921 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.181033 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] federation.caching = True {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.181132 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.181264 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.181344 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.181541 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] federation.driver = sql {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.181635 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.181753 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.181832 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.181988 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.182079 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.182210 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.182330 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.182443 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.182655 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.182850 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.182936 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.183012 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.183106 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.183348 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.183487 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.183619 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.183696 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.183775 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.183891 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] identity.caching = True {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.183975 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.184108 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.184210 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.184552 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.184648 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.184747 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.184850 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.184940 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.185004 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.185061 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] identity.driver = sql {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.185128 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.185236 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.185416 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.185561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.185685 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.185834 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.185995 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.186147 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.186283 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.186416 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.186549 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.186682 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.186891 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.187032 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.187168 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.password = **** {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.187302 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.187442 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.187576 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.187718 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.187853 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.187986 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.188131 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.188272 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.188406 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.188548 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.188683 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.188826 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.188960 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.189092 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.189225 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.189366 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.189506 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.189589 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.189649 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.189720 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.189790 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.189856 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.189928 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.189998 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.190076 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.190135 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.190204 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.190271 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.190342 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.190401 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.user = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.190457 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.190513 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.190579 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.190662 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.190735 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.190813 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.190938 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.191062 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.191154 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.191232 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.191414 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.191569 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.191647 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.191722 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.191812 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.191889 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.192072 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.password = **** {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.192198 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.192278 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.192351 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.192525 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.192651 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.192732 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.192815 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.192971 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.193097 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.193191 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.193268 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.193430 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.193557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.193637 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.193710 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.193889 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.194046 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.194222 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.194346 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.194502 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.194743 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.194979 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.195065 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.195229 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.195310 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.195465 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.195565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.195692 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.195773 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.195925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.196005 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.196153 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.user = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.196231 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.196393 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.196473 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] policy.driver = sql {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.196616 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.196694 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.196854 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.196932 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.197084 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.197165 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.197312 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] receipt.caching = True {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.197391 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.197543 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.197621 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.197781 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.197860 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.198008 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.198086 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.198232 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.198308 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.198461 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.198539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.198693 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.198788 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] resource.caching = True {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.198961 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.199038 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.199203 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.199282 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] resource.driver = sql {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.199431 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.199508 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.199674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.199751 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.199915 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.199993 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.200146 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] revoke.caching = True {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.200243 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.200367 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.200444 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.200599 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.200678 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.200831 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.200908 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] role.cache_time = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.201055 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] role.caching = True {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.201132 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.201285 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.201363 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] role.driver = sql {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.201514 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] role.list_limit = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.201591 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.201755 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.201831 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.201994 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.202073 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.202223 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.202300 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.202464 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.202541 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] policy.driver = sql {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.202687 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.202797 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.202953 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.203032 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.203186 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.203263 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.203415 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] receipt.caching = True {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.203490 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.203637 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.203714 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.203876 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.203954 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.204112 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.204190 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.204342 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.204420 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.204576 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.204681 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.204816 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] resource.caching = True {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.205001 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.205080 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.205232 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.205311 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] resource.driver = sql {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.205476 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.205555 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.205719 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.205801 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.205963 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.206077 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.206204 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] revoke.caching = True {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.206283 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.206430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.206507 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.206665 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.206744 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.206933 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] role.cache_time = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.207018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.207163 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.207240 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] role.caching = True {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.207390 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.207468 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] role.driver = sql {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.207614 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.207695 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] role.list_limit = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.207838 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.207917 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.208081 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.208160 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.208326 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.208404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.208566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.208644 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.208798 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.208875 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.209026 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.209104 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.209248 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] token.cache_time = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.209326 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.209512 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] token.caching = True {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.209589 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.209923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.210174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] token.provider = fernet {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.210284 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.210444 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.210532 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.210657 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.210744 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.210925 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.211008 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.211159 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.211237 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.211396 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.211638 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.211717 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.211875 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.211952 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] trust.driver = sql {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.212104 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.212190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.212337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.212416 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.212564 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.212642 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.212804 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.212890 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.213035 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.213112 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.213287 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.213365 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.213521 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.213608 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.213760 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.213852 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.213989 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.214067 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] database.connection = **** {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.214218 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.214297 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.214450 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.214564 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.214686 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.214794 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.214946 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.215026 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.215176 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.215267 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.215405 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.215485 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.215634 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.215713 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.215859 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] token.cache_time = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.215944 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.216094 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] token.caching = True {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.216172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.216326 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.216403 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.216564 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.216650 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] token.provider = fernet {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.216792 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.216871 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.217032 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.217111 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.217262 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.217349 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.217503 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.217582 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.217728 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.217806 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.217964 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.218044 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.218191 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.218269 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] trust.driver = sql {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.218340 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=99839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 27 09:37:44.218410 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.218647 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.218904 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.219148 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.219424 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.219652 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.219894 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.220160 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.220417 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] database.connection = **** {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.220657 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.220901 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.221136 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.221376 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.221606 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.221840 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.222074 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.222308 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.222550 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.222804 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.223053 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.223622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.223622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.223789 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.223977 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.224205 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.224442 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.224674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 09:37:44.224842 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=99838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 27 09:37:44.247648 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.247904 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.248130 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.250809 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.251033 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.251256 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.256777 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.260433 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.285573 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.285762 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.287686 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.288023 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.339341 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.340666 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.387299 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.387516 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.389947 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.390177 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.453297 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.453519 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.453720 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.453954 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.454163 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.454363 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.454800 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.455023 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.455245 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.455466 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.455686 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.455894 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.477500 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.477781 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.477921 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.478173 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.478296 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.478366 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.478450 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.478552 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.478627 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.478780 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.478863 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.479104 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.479297 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.479530 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.489950 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.490552 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.502967 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.503148 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.503219 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.503281 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.503354 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.503440 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.503654 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.503779 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.503846 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.503907 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.503979 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.504065 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.504140 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=99838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.504203 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=99839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 09:37:44.521031 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.521183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 27 09:37:44.521553 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.521676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.521745 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 27 09:37:44.521806 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 27 09:37:44.522012 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.522174 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.522486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.522801 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.522923 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 27 09:37:44.523070 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.523195 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.523408 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.523788 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.523917 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.532375 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.532621 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.532915 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.533188 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.533311 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.533528 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.533798 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.534077 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.540594 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=99839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.541903 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=99838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.543486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=99839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.543764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.544051 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.544328 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.544604 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.544774 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=99838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.544868 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.545082 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.545205 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.545339 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.545431 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.545615 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.545736 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.545900 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.546038 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.546127 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.546202 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.546415 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.546669 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.546967 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.547239 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.547501 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.568597 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.570095 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=99839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.570376 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.570891 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.572341 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=99838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.572626 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.576598 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=99839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.576872 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.577152 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.578881 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=99838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.579169 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.579448 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.583418 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=99839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.584247 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.586457 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=99838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.586751 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.587957 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=99839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.588233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.588508 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.588783 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.589052 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.589325 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.589637 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.589851 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.590804 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=99838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.591108 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.591391 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.591669 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.591941 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.592215 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.592483 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.592752 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.605154 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.605422 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.608864 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.609146 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.609383 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=99839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.612717 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.613013 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.613160 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=99838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.617028 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.617305 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.617545 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=99839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.620603 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=99839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.621537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=99838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.623780 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.624080 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.624353 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.624642 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.624783 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=99838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.624902 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.625190 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.627815 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.628125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.628407 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.628695 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.628977 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.629237 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.640964 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=99839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.641250 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.641517 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.641774 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.645330 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=99838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.645587 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.645880 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.646095 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.648684 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.650181 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.651713 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.651982 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.653482 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.654554 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=99839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.654862 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.654989 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.655150 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.655430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.655811 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.656526 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.656798 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.659417 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=99838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.659708 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.660335 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.660622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.661006 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.667189 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=99839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.667462 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.667735 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.668007 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.668382 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.668665 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.668935 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.673578 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=99838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.673859 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.674137 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.674405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.674808 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.675094 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.675381 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.684119 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=99839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.686995 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=99839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.689823 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.691254 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.691340 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=99838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.692679 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=99839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.692967 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.693355 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.694863 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=99838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.697725 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.699161 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.699650 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.700621 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=99838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.700899 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.701107 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=99839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.701286 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.703935 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.704316 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.704594 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.704864 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.707598 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.709054 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=99838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.712489 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.712721 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=99839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.712853 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.713017 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.713155 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.713273 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.713436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.720996 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=99839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.721221 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=99838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.721309 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.721508 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.721601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.721783 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.721873 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.722049 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.722314 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.722577 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.722887 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.723166 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.723427 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.723690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.723948 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.724205 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.724467 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=99839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.730189 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=99838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 09:37:44.730485 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.730784 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.731062 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.731335 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.731613 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.731890 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.732153 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.732428 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.732696 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.732972 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.733277 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.733537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.733812 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=99838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 09:37:44.757176 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f60c1e19c0 pid: 99839 (default app) Sep 27 09:37:44.760588 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860c66a-651b-47c8-9326-7eb57255c77e None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:37:44.760877 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860c66a-651b-47c8-9326-7eb57255c77e None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:37:44.761137 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860c66a-651b-47c8-9326-7eb57255c77e None None] PATH_INFO: `/v3` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:37:44.765252 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Tue Sep 27 09:37:44 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:37:44.767797 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f60c1e19c0 pid: 99838 (default app) Sep 27 09:37:52.114686 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316a5e7-e03c-47da-8169-915c925898f5 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:37:52.115283 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316a5e7-e03c-47da-8169-915c925898f5 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:37:52.115283 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316a5e7-e03c-47da-8169-915c925898f5 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:37:52.116775 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 2/2] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:37:52.124561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b6bc4-63e9-433c-8acb-a133e59a5061 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:37:52.125160 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b6bc4-63e9-433c-8acb-a133e59a5061 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:37:52.125160 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b6bc4-63e9-433c-8acb-a133e59a5061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:37:52.203176 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: INFO dbcounter [None req-699b6bc4-63e9-433c-8acb-a133e59a5061 None None] Registered counter for database keystone Sep 27 09:37:52.223335 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG oslo_db.sqlalchemy.engines [None req-699b6bc4-63e9-433c-8acb-a133e59a5061 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99838) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 09:37:52.230826 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writer thread running {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 09:37:52.419670 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG passlib.handlers.bcrypt [None req-699b6bc4-63e9-433c-8acb-a133e59a5061 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=99838) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 27 09:37:52.419960 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG passlib.handlers.bcrypt [None req-699b6bc4-63e9-433c-8acb-a133e59a5061 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=99838) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 27 09:37:52.480069 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-699b6bc4-63e9-433c-8acb-a133e59a5061 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:37:52.481697 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-699b6bc4-63e9-433c-8acb-a133e59a5061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:37:52.617381 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 1/3] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:37:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 496 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 27 09:37:53.128244 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316a5e7-e03c-47da-8169-915c925898f5 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:37:53.218952 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: INFO dbcounter [None req-6316a5e7-e03c-47da-8169-915c925898f5 None None] Registered counter for database keystone Sep 27 09:37:53.242475 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG oslo_db.sqlalchemy.engines [None req-6316a5e7-e03c-47da-8169-915c925898f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99839) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 09:37:53.249935 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writer thread running {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 09:37:53.373217 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316a5e7-e03c-47da-8169-915c925898f5 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:37:53.378095 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add77c67-706f-4005-8ee9-69f752685e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:37:53.378828 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add77c67-706f-4005-8ee9-69f752685e9e admin admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:37:53.379046 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add77c67-706f-4005-8ee9-69f752685e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:37:53.379306 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add77c67-706f-4005-8ee9-69f752685e9e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:37:53.388730 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add77c67-706f-4005-8ee9-69f752685e9e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:37:53.452749 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: WARNING keystone.common.rbac_enforcer.enforcer [None req-add77c67-706f-4005-8ee9-69f752685e9e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 27 09:37:53.453087 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add77c67-706f-4005-8ee9-69f752685e9e admin admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:37:53.464539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 3/4] 10.222.0.49 () {58 vars in 1324 bytes} [Tue Sep 27 09:37:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 09:37:53.470959 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b6bc4-63e9-433c-8acb-a133e59a5061 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:37:53.493409 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b6bc4-63e9-433c-8acb-a133e59a5061 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:37:53.499172 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8627a-6578-40fc-a675-511be957dc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:37:53.500656 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8627a-6578-40fc-a675-511be957dc8f admin admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:37:53.500939 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8627a-6578-40fc-a675-511be957dc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:37:53.501209 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8627a-6578-40fc-a675-511be957dc8f admin admin] PATH_INFO: `/v3/projects/50dc269bfa7c47b5b3c652045ebe51ff` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:37:53.502788 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8627a-6578-40fc-a675-511be957dc8f admin admin] RBAC: Authorizing `identity:get_project(project_id=50dc269bfa7c47b5b3c652045ebe51ff)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:37:53.567036 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: WARNING keystone.common.rbac_enforcer.enforcer [None req-17f8627a-6578-40fc-a675-511be957dc8f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 27 09:37:53.567386 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8627a-6578-40fc-a675-511be957dc8f admin admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:37:53.573749 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 2/5] 10.222.0.49 () {56 vars in 1207 bytes} [Tue Sep 27 09:37:53 2022] GET /identity/v3/projects/50dc269bfa7c47b5b3c652045ebe51ff => generated 344 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:37:56.033992 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f8c60-2052-472a-a4a0-9ba4bce79971 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:37:56.034539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f8c60-2052-472a-a4a0-9ba4bce79971 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:37:56.034539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f8c60-2052-472a-a4a0-9ba4bce79971 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:37:56.039052 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 4/6] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:37:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:37:56.044865 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a0427-ae88-41ad-a0d0-ead536a71024 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:37:56.045304 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a0427-ae88-41ad-a0d0-ead536a71024 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:37:56.045408 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a0427-ae88-41ad-a0d0-ead536a71024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:37:56.066157 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-538a0427-ae88-41ad-a0d0-ead536a71024 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:37:56.067740 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-538a0427-ae88-41ad-a0d0-ead536a71024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:37:56.076535 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 3/7] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:37:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 27 09:37:56.404638 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f8c60-2052-472a-a4a0-9ba4bce79971 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:37:56.419737 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f8c60-2052-472a-a4a0-9ba4bce79971 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:37:56.424778 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac25a33-78d9-4dc0-bb49-c7dae710ed15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:37:56.425415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac25a33-78d9-4dc0-bb49-c7dae710ed15 admin admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:37:56.425710 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac25a33-78d9-4dc0-bb49-c7dae710ed15 admin admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:37:56.425978 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac25a33-78d9-4dc0-bb49-c7dae710ed15 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:37:56.434796 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac25a33-78d9-4dc0-bb49-c7dae710ed15 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:37:56.436618 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac25a33-78d9-4dc0-bb49-c7dae710ed15 admin admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:37:56.445966 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 5/8] 10.222.0.49 () {58 vars in 1324 bytes} [Tue Sep 27 09:37:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 09:37:56.452116 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a0427-ae88-41ad-a0d0-ead536a71024 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:37:56.462028 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a0427-ae88-41ad-a0d0-ead536a71024 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:37:56.467890 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fdf97-780e-433a-84cb-c0d646da1160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:37:56.468534 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fdf97-780e-433a-84cb-c0d646da1160 admin admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:37:56.468812 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fdf97-780e-433a-84cb-c0d646da1160 admin admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:37:56.469079 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fdf97-780e-433a-84cb-c0d646da1160 admin admin] PATH_INFO: `/v3/users/e6a28914e72f4ed6b89baeb8d519808a` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:37:56.470547 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fdf97-780e-433a-84cb-c0d646da1160 admin admin] RBAC: Authorizing `identity:get_user(user_id=e6a28914e72f4ed6b89baeb8d519808a)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:37:56.472456 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fdf97-780e-433a-84cb-c0d646da1160 admin admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:37:56.474019 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 4/9] 10.222.0.49 () {56 vars in 1198 bytes} [Tue Sep 27 09:37:56 2022] GET /identity/v3/users/e6a28914e72f4ed6b89baeb8d519808a => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:37:59.005605 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49adfd-a7c5-4821-9a98-cbbdc0a0e492 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:37:59.006141 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49adfd-a7c5-4821-9a98-cbbdc0a0e492 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:37:59.006141 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49adfd-a7c5-4821-9a98-cbbdc0a0e492 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:37:59.007713 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 6/10] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:37:59.013256 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c66da-b5b6-44d8-8aab-4a64e6da2233 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:37:59.013741 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c66da-b5b6-44d8-8aab-4a64e6da2233 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:37:59.013919 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c66da-b5b6-44d8-8aab-4a64e6da2233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:37:59.015344 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63150d2-12b9-4656-9761-69433fb98f77 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:37:59.015624 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63150d2-12b9-4656-9761-69433fb98f77 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:37:59.015895 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63150d2-12b9-4656-9761-69433fb98f77 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:37:59.017134 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 7/11] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:37:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:37:59.023008 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7005acf-063e-43f8-a0af-59ad4cfd7251 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:37:59.023292 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7005acf-063e-43f8-a0af-59ad4cfd7251 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:37:59.023562 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7005acf-063e-43f8-a0af-59ad4cfd7251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:37:59.033430 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-e46c66da-b5b6-44d8-8aab-4a64e6da2233 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:37:59.034656 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-e46c66da-b5b6-44d8-8aab-4a64e6da2233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:37:59.067782 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG passlib.handlers.bcrypt [None req-d7005acf-063e-43f8-a0af-59ad4cfd7251 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=99839) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 27 09:37:59.068145 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG passlib.handlers.bcrypt [None req-d7005acf-063e-43f8-a0af-59ad4cfd7251 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=99839) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 27 09:37:59.118796 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-d7005acf-063e-43f8-a0af-59ad4cfd7251 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:37:59.119866 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 5/12] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:37:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:37:59.120465 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-d7005acf-063e-43f8-a0af-59ad4cfd7251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:37:59.231418 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 8/13] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:37:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 09:37:59.438614 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c66da-b5b6-44d8-8aab-4a64e6da2233 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:37:59.464476 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:37:59.560186 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7005acf-063e-43f8-a0af-59ad4cfd7251 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:37:59.665266 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c66da-b5b6-44d8-8aab-4a64e6da2233 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:37:59.668751 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7005acf-063e-43f8-a0af-59ad4cfd7251 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:37:59.671166 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:37:59.700615 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a644f6-525b-4e17-a583-ef06827f86ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:37:59.701162 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a644f6-525b-4e17-a583-ef06827f86ec None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:37:59.701435 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a644f6-525b-4e17-a583-ef06827f86ec None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:37:59.701714 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a644f6-525b-4e17-a583-ef06827f86ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:37:59.707183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c2850-2993-45d9-b5bd-be4f14d0299a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:37:59.708316 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c2850-2993-45d9-b5bd-be4f14d0299a None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:37:59.708598 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c2850-2993-45d9-b5bd-be4f14d0299a None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:37:59.708866 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c2850-2993-45d9-b5bd-be4f14d0299a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:37:59.721026 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c2850-2993-45d9-b5bd-be4f14d0299a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:37:59.729764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-1a2c2850-2993-45d9-b5bd-be4f14d0299a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:37:59.729764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:37:59.729764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:37:59.729764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:37:59.729764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:37:59.729764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:37:59.729764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:37:59.729764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:37:59.729764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:37:59.729764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:37:59.729764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:37:59.729764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:37:59.729764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:37:59.729764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:37:59.729764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:37:59.729764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:37:59.731170 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:37:59.731170 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:37:59.731170 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:37:59.731170 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:37:59.731170 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:37:59.731170 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:37:59.731170 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:37:59.731170 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:37:59.731170 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:37:59.731170 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:37:59.731170 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:37:59.731170 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:37:59.731170 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:37:59.731170 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:37:59.731170 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:37:59.731170 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:37:59.732264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:37:59.732264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:37:59.732264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:37:59.732264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:37:59.732264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:37:59.732264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:37:59.732264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:37:59.732264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:37:59.732264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:37:59.732264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:37:59.732264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:37:59.732264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:37:59.732264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 9/14] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 27 09:37:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:37:59.737024 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c2850-2993-45d9-b5bd-be4f14d0299a None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:37:59.772469 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a644f6-525b-4e17-a583-ef06827f86ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:37:59.773987 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a644f6-525b-4e17-a583-ef06827f86ec None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:37:59.797722 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:37:59.839396 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c2850-2993-45d9-b5bd-be4f14d0299a None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:37:59.876112 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafe240-448f-480d-816c-a2547dc45e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:37:59.876742 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafe240-448f-480d-816c-a2547dc45e09 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:37:59.877022 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafe240-448f-480d-816c-a2547dc45e09 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:37:59.877293 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafe240-448f-480d-816c-a2547dc45e09 None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:37:59.877965 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cafe240-448f-480d-816c-a2547dc45e09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:37:59.878267 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cafe240-448f-480d-816c-a2547dc45e09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:37:59.879760 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cafe240-448f-480d-816c-a2547dc45e09 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:37:59.879852 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 6/15] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:37:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:37:59.885615 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a644f6-525b-4e17-a583-ef06827f86ec None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:37:59.892875 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 10/16] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:37:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:37:59.899331 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafe240-448f-480d-816c-a2547dc45e09 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:37:59.928687 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:37:59.989746 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a644f6-525b-4e17-a583-ef06827f86ec None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:00.005019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafe240-448f-480d-816c-a2547dc45e09 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:00.013332 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:00.025828 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1cf61-b25d-463d-9fb7-e7c5f7ab05a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:00.026476 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1cf61-b25d-463d-9fb7-e7c5f7ab05a9 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:00.026755 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1cf61-b25d-463d-9fb7-e7c5f7ab05a9 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:00.027062 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1cf61-b25d-463d-9fb7-e7c5f7ab05a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:00.038018 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1cf61-b25d-463d-9fb7-e7c5f7ab05a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:00.039600 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1cf61-b25d-463d-9fb7-e7c5f7ab05a9 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:00.041995 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d359f-26e0-4bf8-88f1-8cf12d2fcb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:00.042685 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d359f-26e0-4bf8-88f1-8cf12d2fcb3f None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:00.042977 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d359f-26e0-4bf8-88f1-8cf12d2fcb3f None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:00.043250 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d359f-26e0-4bf8-88f1-8cf12d2fcb3f None admin] PATH_INFO: `/v3/users/e6a28914e72f4ed6b89baeb8d519808a` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:00.044920 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d359f-26e0-4bf8-88f1-8cf12d2fcb3f None admin] RBAC: Authorizing `identity:get_user(user_id=e6a28914e72f4ed6b89baeb8d519808a)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:00.046451 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d359f-26e0-4bf8-88f1-8cf12d2fcb3f None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:00.048493 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 11/17] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:37:59 2022] GET /identity/v3/users/e6a28914e72f4ed6b89baeb8d519808a => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:38:00.054681 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d359f-26e0-4bf8-88f1-8cf12d2fcb3f None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:00.062886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-9bd1cf61-b25d-463d-9fb7-e7c5f7ab05a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:38:00.062886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:00.062886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:00.062886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:00.062886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:00.062886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:00.062886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:00.062886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:00.062886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:00.062886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:00.062886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:00.062886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:00.062886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:38:00.062886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:38:00.062886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:38:00.062886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:38:00.064125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:00.064125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:00.064125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:00.064125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:00.064125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:00.064125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:00.064125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:00.064125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:00.064125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:00.064125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:00.064125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:00.064125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:00.064125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:00.064125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:00.064125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:00.064125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:00.064125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:38:00.064943 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:38:00.064943 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:38:00.064943 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:38:00.064943 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 7/18] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:37:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:38:00.071290 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1cf61-b25d-463d-9fb7-e7c5f7ab05a9 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:00.183293 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1cf61-b25d-463d-9fb7-e7c5f7ab05a9 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:00.223414 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98337b2a-2109-42dc-a214-82ca616887ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:00.224039 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98337b2a-2109-42dc-a214-82ca616887ad None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:00.224299 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98337b2a-2109-42dc-a214-82ca616887ad None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:00.224565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98337b2a-2109-42dc-a214-82ca616887ad None admin] PATH_INFO: `/v3/domains` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:00.225684 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98337b2a-2109-42dc-a214-82ca616887ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:00.225684 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98337b2a-2109-42dc-a214-82ca616887ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:00.227012 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98337b2a-2109-42dc-a214-82ca616887ad None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:00.247913 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 8/19] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:38:00.283287 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:00.292341 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d359f-26e0-4bf8-88f1-8cf12d2fcb3f None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:00.333908 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e118d-5a23-4570-b1cc-f9569f1bc22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:00.334659 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e118d-5a23-4570-b1cc-f9569f1bc22b None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:00.335031 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e118d-5a23-4570-b1cc-f9569f1bc22b None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:00.335307 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e118d-5a23-4570-b1cc-f9569f1bc22b None admin] PATH_INFO: `/v3/domains/default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:00.336559 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e118d-5a23-4570-b1cc-f9569f1bc22b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:00.338037 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e118d-5a23-4570-b1cc-f9569f1bc22b None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:00.339939 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 12/20] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:38:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:00.346079 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98337b2a-2109-42dc-a214-82ca616887ad None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:00.385661 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:00.461623 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98337b2a-2109-42dc-a214-82ca616887ad None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:00.498441 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030ac35-06d8-49ad-af49-8dbdf45c8ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:00.499024 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030ac35-06d8-49ad-af49-8dbdf45c8ae6 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:00.499298 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030ac35-06d8-49ad-af49-8dbdf45c8ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:00.499583 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030ac35-06d8-49ad-af49-8dbdf45c8ae6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:00.500297 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030ac35-06d8-49ad-af49-8dbdf45c8ae6 None admin] RBAC: Adding query filter params (role.id=7cc7d3c85c794033b590117321e97ccf, scope.domain.id=default, user.id=e6a28914e72f4ed6b89baeb8d519808a) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:00.500597 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030ac35-06d8-49ad-af49-8dbdf45c8ae6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:00.502105 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030ac35-06d8-49ad-af49-8dbdf45c8ae6 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:00.510303 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 9/21] 10.222.0.49 () {56 vars in 1322 bytes} [Tue Sep 27 09:38:00 2022] GET /identity/v3/role_assignments?user.id=e6a28914e72f4ed6b89baeb8d519808a&scope.domain.id=default&role.id=7cc7d3c85c794033b590117321e97ccf => generated 233 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:03.957446 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd78d4-13ac-406d-aef4-563589609892 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:03.958254 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd78d4-13ac-406d-aef4-563589609892 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:03.958254 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd78d4-13ac-406d-aef4-563589609892 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:03.961820 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 13/22] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:03.968730 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291348f-264b-43a1-a6dc-3a0a52eba8cf None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:03.969524 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291348f-264b-43a1-a6dc-3a0a52eba8cf None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:03.969851 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291348f-264b-43a1-a6dc-3a0a52eba8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:04.008039 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-c291348f-264b-43a1-a6dc-3a0a52eba8cf None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:04.009992 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-c291348f-264b-43a1-a6dc-3a0a52eba8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:04.106933 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896f334-f6a8-4f3a-a907-d19f1914500b None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:04.107353 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896f334-f6a8-4f3a-a907-d19f1914500b None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:04.107814 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896f334-f6a8-4f3a-a907-d19f1914500b None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:04.110368 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 14/23] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:38:04.118890 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f7abc-4b13-479b-9834-50d3f299329f None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:04.119336 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f7abc-4b13-479b-9834-50d3f299329f None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:04.119813 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f7abc-4b13-479b-9834-50d3f299329f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:04.184453 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-e94f7abc-4b13-479b-9834-50d3f299329f None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:04.186860 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-e94f7abc-4b13-479b-9834-50d3f299329f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:04.207241 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 10/24] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:04.208643 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5fb53-8682-4ce0-8321-cda603600595 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:04.208894 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5fb53-8682-4ce0-8321-cda603600595 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:04.209113 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5fb53-8682-4ce0-8321-cda603600595 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:04.211678 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 11/25] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:04.220280 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbb6c4-377f-4831-babc-cf8aadb1918a None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:04.221732 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbb6c4-377f-4831-babc-cf8aadb1918a None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:04.222186 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbb6c4-377f-4831-babc-cf8aadb1918a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:04.265897 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-54cbb6c4-377f-4831-babc-cf8aadb1918a None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:04.268869 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-54cbb6c4-377f-4831-babc-cf8aadb1918a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:04.310179 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:04.380607 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 15/26] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 09:38:04.397912 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 12/27] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:04.552779 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f7abc-4b13-479b-9834-50d3f299329f None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:04.633129 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c521af0-e296-4263-b695-7757c9948cb3 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:04.633417 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c521af0-e296-4263-b695-7757c9948cb3 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:04.633718 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c521af0-e296-4263-b695-7757c9948cb3 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:04.635299 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 13/28] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:38:04.643743 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b269a6-62d5-45dd-8b3d-d5783f83f79f None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:04.644025 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b269a6-62d5-45dd-8b3d-d5783f83f79f None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:04.644314 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b269a6-62d5-45dd-8b3d-d5783f83f79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:04.672935 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-36b269a6-62d5-45dd-8b3d-d5783f83f79f None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:04.674172 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-36b269a6-62d5-45dd-8b3d-d5783f83f79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:04.738732 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:04.763868 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f7abc-4b13-479b-9834-50d3f299329f None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:04.842126 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 14/29] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:04.844536 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b269a6-62d5-45dd-8b3d-d5783f83f79f None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:04.848982 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533d37f-c31d-4f37-b951-35c7a649f2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:04.849925 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533d37f-c31d-4f37-b951-35c7a649f2be None admin] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:04.850966 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533d37f-c31d-4f37-b951-35c7a649f2be None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:04.852356 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533d37f-c31d-4f37-b951-35c7a649f2be None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:04.853242 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0533d37f-c31d-4f37-b951-35c7a649f2be None admin] RBAC: Authorizing `identity:create_role()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:04.860743 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0533d37f-c31d-4f37-b951-35c7a649f2be None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:05.004260 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:05.034789 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b269a6-62d5-45dd-8b3d-d5783f83f79f None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:05.075819 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 16/30] 10.222.0.49 () {60 vars in 1131 bytes} [Tue Sep 27 09:38:04 2022] POST /identity/v3/roles => generated 225 bytes in 524 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:38:05.079935 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533d37f-c31d-4f37-b951-35c7a649f2be None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:05.089436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1fdbf-b1ce-463f-8514-cd3ca35221e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:05.090442 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1fdbf-b1ce-463f-8514-cd3ca35221e6 None admin] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:05.090723 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1fdbf-b1ce-463f-8514-cd3ca35221e6 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:05.091039 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1fdbf-b1ce-463f-8514-cd3ca35221e6 None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:05.091734 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1fdbf-b1ce-463f-8514-cd3ca35221e6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:05.094494 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1fdbf-b1ce-463f-8514-cd3ca35221e6 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:05.286449 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 15/31] 10.222.0.49 () {60 vars in 1131 bytes} [Tue Sep 27 09:38:04 2022] POST /identity/v3/roles => generated 219 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:38:05.333533 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533d37f-c31d-4f37-b951-35c7a649f2be None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:05.391842 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864cb758-e349-41d3-8718-a75026afb850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:05.392744 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cb758-e349-41d3-8718-a75026afb850 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:05.393164 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cb758-e349-41d3-8718-a75026afb850 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:05.393578 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cb758-e349-41d3-8718-a75026afb850 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:05.426982 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864cb758-e349-41d3-8718-a75026afb850 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:05.429651 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864cb758-e349-41d3-8718-a75026afb850 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:05.453583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-864cb758-e349-41d3-8718-a75026afb850 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:38:05.453583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:05.453583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:05.453583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:05.453583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:05.453583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:05.453583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:05.453583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:05.453583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:05.453583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:05.453583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:05.453583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:05.453583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:38:05.453583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:38:05.453583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:38:05.453583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:38:05.454709 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:05.454709 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:05.454709 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:05.454709 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:05.454709 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:05.454709 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:05.454709 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:05.454709 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:05.454709 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:05.454709 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:05.454709 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:05.454709 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:05.454709 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:05.454709 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:05.454709 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:05.454709 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:05.454709 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:38:05.455732 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:38:05.455732 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:38:05.455732 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:38:05.457652 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 17/32] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:38:05.463914 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1fdbf-b1ce-463f-8514-cd3ca35221e6 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:05.626783 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1fdbf-b1ce-463f-8514-cd3ca35221e6 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:05.664748 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef8b0b-5146-414f-b520-46c615714852 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:05.664977 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef8b0b-5146-414f-b520-46c615714852 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:05.665286 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef8b0b-5146-414f-b520-46c615714852 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:05.666619 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 18/33] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:05.674123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d30e8-a354-4171-a677-731459ac5fde None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:05.674398 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d30e8-a354-4171-a677-731459ac5fde None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:05.674689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d30e8-a354-4171-a677-731459ac5fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:05.680203 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9017686-46bc-4617-ae81-e8c376758300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:05.681703 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9017686-46bc-4617-ae81-e8c376758300 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:05.682388 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9017686-46bc-4617-ae81-e8c376758300 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:05.683102 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9017686-46bc-4617-ae81-e8c376758300 None admin] PATH_INFO: `/v3/domains` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:05.683890 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:05.684838 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9017686-46bc-4617-ae81-e8c376758300 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:05.685030 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9017686-46bc-4617-ae81-e8c376758300 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:05.687985 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9017686-46bc-4617-ae81-e8c376758300 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:05.704195 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-e77d30e8-a354-4171-a677-731459ac5fde None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:05.706220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-e77d30e8-a354-4171-a677-731459ac5fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:05.714137 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 16/34] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:38:05.715652 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9017686-46bc-4617-ae81-e8c376758300 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:05.736007 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:05.829017 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 19/35] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:05.830822 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d30e8-a354-4171-a677-731459ac5fde None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:05.887296 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9017686-46bc-4617-ae81-e8c376758300 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:05.942420 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80f3e1-4bfe-41d9-9b8c-b3e4cbaf7d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:05.943790 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80f3e1-4bfe-41d9-9b8c-b3e4cbaf7d59 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:05.944455 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80f3e1-4bfe-41d9-9b8c-b3e4cbaf7d59 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:05.945109 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80f3e1-4bfe-41d9-9b8c-b3e4cbaf7d59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:05.965392 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd80f3e1-4bfe-41d9-9b8c-b3e4cbaf7d59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:38:05.976023 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-cd80f3e1-4bfe-41d9-9b8c-b3e4cbaf7d59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:38:05.976023 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:05.976023 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:05.976023 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:05.976023 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:05.976023 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:05.976023 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:05.976023 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:05.976023 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:05.976023 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:05.976023 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:05.976023 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:05.976023 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:38:05.976023 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:38:05.976023 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:38:05.976023 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:38:05.976923 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:38:05.976923 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:38:05.976923 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:38:05.976923 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:38:05.976923 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:05.976923 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:05.976923 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:05.976923 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:05.976923 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:05.976923 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:05.976923 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:05.976923 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:05.976923 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:05.976923 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:05.976923 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:05.976923 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:05.977668 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:05.977668 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:05.977668 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:05.977668 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:05.977668 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:38:05.977668 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:38:05.977668 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:38:05.977668 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:38:05.977668 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:38:05.977668 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:38:05.977668 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:38:05.977668 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:38:05.977668 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 17/36] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 27 09:38:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:38:05.978893 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d9010-d64f-4763-a99e-da6da95304cf None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:05.978998 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d9010-d64f-4763-a99e-da6da95304cf None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:05.979204 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d9010-d64f-4763-a99e-da6da95304cf None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:05.980548 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 18/37] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:05.985705 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d9010-d64f-4763-a99e-da6da95304cf None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:06.019786 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d30e8-a354-4171-a677-731459ac5fde None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:06.059803 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:06.074306 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92da3e5-5063-40d6-b03d-aba8788b157c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:06.075367 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92da3e5-5063-40d6-b03d-aba8788b157c None admin] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:06.075806 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92da3e5-5063-40d6-b03d-aba8788b157c None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:06.076280 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92da3e5-5063-40d6-b03d-aba8788b157c None admin] PATH_INFO: `/v3/projects` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:06.077366 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92da3e5-5063-40d6-b03d-aba8788b157c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:06.079917 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92da3e5-5063-40d6-b03d-aba8788b157c None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:06.088473 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:06.101479 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d9010-d64f-4763-a99e-da6da95304cf None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:06.128424 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 20/38] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Sep 27 09:38:05 2022] POST /identity/v3/projects => generated 301 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:38:06.129731 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeafbe1-addf-426b-8f7b-c25f00845ded None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:06.130023 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeafbe1-addf-426b-8f7b-c25f00845ded None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:06.130312 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeafbe1-addf-426b-8f7b-c25f00845ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:06.153403 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-ffeafbe1-addf-426b-8f7b-c25f00845ded None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:06.154991 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-ffeafbe1-addf-426b-8f7b-c25f00845ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:06.173190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671add7-f1c3-4fe8-a64c-88c6025a260a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:06.175824 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671add7-f1c3-4fe8-a64c-88c6025a260a None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:06.176652 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671add7-f1c3-4fe8-a64c-88c6025a260a None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:06.177561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671add7-f1c3-4fe8-a64c-88c6025a260a None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:06.179847 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671add7-f1c3-4fe8-a64c-88c6025a260a None admin] RBAC: Adding query filter params (name=admin) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:06.180743 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671add7-f1c3-4fe8-a64c-88c6025a260a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:06.185142 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671add7-f1c3-4fe8-a64c-88c6025a260a None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:06.212693 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 19/39] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:38:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:06.214444 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671add7-f1c3-4fe8-a64c-88c6025a260a None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:06.255088 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 21/40] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:06.256130 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeafbe1-addf-426b-8f7b-c25f00845ded None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:06.380471 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671add7-f1c3-4fe8-a64c-88c6025a260a None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:06.428710 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:06.433937 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeafbe1-addf-426b-8f7b-c25f00845ded None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:06.435322 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7a6e1-b597-4552-a91d-f60b429b0db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:06.436230 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7a6e1-b597-4552-a91d-f60b429b0db9 None admin] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:06.436524 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7a6e1-b597-4552-a91d-f60b429b0db9 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:06.436799 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7a6e1-b597-4552-a91d-f60b429b0db9 None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:06.438650 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7a6e1-b597-4552-a91d-f60b429b0db9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:06.440237 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7a6e1-b597-4552-a91d-f60b429b0db9 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:06.462867 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:06.473961 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 20/41] 10.222.0.49 () {60 vars in 1131 bytes} [Tue Sep 27 09:38:06 2022] POST /identity/v3/roles => generated 223 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:38:06.503800 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29672bc6-c1cd-4866-880b-6e8681e08223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:06.504966 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29672bc6-c1cd-4866-880b-6e8681e08223 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:06.505428 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29672bc6-c1cd-4866-880b-6e8681e08223 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:06.505865 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29672bc6-c1cd-4866-880b-6e8681e08223 None admin] PATH_INFO: `/v3/users/e6a28914e72f4ed6b89baeb8d519808a` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:06.508423 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29672bc6-c1cd-4866-880b-6e8681e08223 None admin] RBAC: Authorizing `identity:get_user(user_id=e6a28914e72f4ed6b89baeb8d519808a)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:06.511239 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29672bc6-c1cd-4866-880b-6e8681e08223 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:06.514614 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 22/42] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:38:06 2022] GET /identity/v3/users/e6a28914e72f4ed6b89baeb8d519808a => generated 247 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:06.523369 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7a6e1-b597-4552-a91d-f60b429b0db9 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:06.617697 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29672bc6-c1cd-4866-880b-6e8681e08223 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:06.679281 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7a6e1-b597-4552-a91d-f60b429b0db9 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:06.741872 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07779dd7-823c-4807-9de0-7fe9ca703fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:06.742744 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07779dd7-823c-4807-9de0-7fe9ca703fe8 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:06.743294 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07779dd7-823c-4807-9de0-7fe9ca703fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:06.743752 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07779dd7-823c-4807-9de0-7fe9ca703fe8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:06.745437 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29672bc6-c1cd-4866-880b-6e8681e08223 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:06.745926 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07779dd7-823c-4807-9de0-7fe9ca703fe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:06.748479 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07779dd7-823c-4807-9de0-7fe9ca703fe8 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:06.753687 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 21/43] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:38:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:06.760542 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07779dd7-823c-4807-9de0-7fe9ca703fe8 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:06.802472 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08cdf6-0ea3-4549-8256-99fdb3fc4360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:06.803546 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08cdf6-0ea3-4549-8256-99fdb3fc4360 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:06.804097 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08cdf6-0ea3-4549-8256-99fdb3fc4360 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:06.804375 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08cdf6-0ea3-4549-8256-99fdb3fc4360 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:06.805613 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08cdf6-0ea3-4549-8256-99fdb3fc4360 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:06.807157 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08cdf6-0ea3-4549-8256-99fdb3fc4360 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:06.808831 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 23/44] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:38:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:06.814897 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08cdf6-0ea3-4549-8256-99fdb3fc4360 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:06.856469 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:06.871947 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:06.909504 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07779dd7-823c-4807-9de0-7fe9ca703fe8 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:06.922933 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08cdf6-0ea3-4549-8256-99fdb3fc4360 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:06.948100 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc537d-dbd0-402a-ad7a-032f02fc8757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:06.948787 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc537d-dbd0-402a-ad7a-032f02fc8757 None admin] REQUEST_METHOD: `PUT` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:06.949063 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc537d-dbd0-402a-ad7a-032f02fc8757 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:06.949354 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc537d-dbd0-402a-ad7a-032f02fc8757 None admin] PATH_INFO: `/v3/domains/default/users/e6a28914e72f4ed6b89baeb8d519808a/roles/7cc7d3c85c794033b590117321e97ccf` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:06.951360 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc537d-dbd0-402a-ad7a-032f02fc8757 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e6a28914e72f4ed6b89baeb8d519808a, role_id=7cc7d3c85c794033b590117321e97ccf)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:06.952850 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc537d-dbd0-402a-ad7a-032f02fc8757 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:06.960628 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76a84c-0492-433e-a3a2-d10f727aa04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:06.961400 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76a84c-0492-433e-a3a2-d10f727aa04e None admin] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:06.961819 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76a84c-0492-433e-a3a2-d10f727aa04e None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:06.962117 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76a84c-0492-433e-a3a2-d10f727aa04e None admin] PATH_INFO: `/v3/projects` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:06.962745 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76a84c-0492-433e-a3a2-d10f727aa04e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:06.964242 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76a84c-0492-433e-a3a2-d10f727aa04e None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:06.969814 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 22/45] 10.222.0.49 () {58 vars in 1361 bytes} [Tue Sep 27 09:38:06 2022] PUT /identity/v3/domains/default/users/e6a28914e72f4ed6b89baeb8d519808a/roles/7cc7d3c85c794033b590117321e97ccf => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 09:38:07.002362 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Sep 27 09:38:06 2022] POST /identity/v3/projects => generated 312 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 09:38:09.501959 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c28c8e-1205-4a43-bf36-cd0db51f701d None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:09.502516 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c28c8e-1205-4a43-bf36-cd0db51f701d None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:09.502891 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c28c8e-1205-4a43-bf36-cd0db51f701d None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:09.505156 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 23/47] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:09.511228 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ce0d4-6870-4970-85e5-8a3f90ecc7f4 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:09.511700 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ce0d4-6870-4970-85e5-8a3f90ecc7f4 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:09.511780 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ce0d4-6870-4970-85e5-8a3f90ecc7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:09.533730 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-453ce0d4-6870-4970-85e5-8a3f90ecc7f4 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:09.535404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-453ce0d4-6870-4970-85e5-8a3f90ecc7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:09.584101 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccdbdd-e183-4756-be90-22a47c5cf041 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:09.584582 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccdbdd-e183-4756-be90-22a47c5cf041 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:09.584928 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccdbdd-e183-4756-be90-22a47c5cf041 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:09.586707 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 24/48] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:09.592372 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143cc4d-3b62-4bba-a2c4-a5e690c83401 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:09.592652 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143cc4d-3b62-4bba-a2c4-a5e690c83401 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:09.592930 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143cc4d-3b62-4bba-a2c4-a5e690c83401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:09.616818 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-c143cc4d-3b62-4bba-a2c4-a5e690c83401 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:09.618352 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-c143cc4d-3b62-4bba-a2c4-a5e690c83401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:09.622319 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 25/49] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:09.693566 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 25/50] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 09:38:09.958003 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ce0d4-6870-4970-85e5-8a3f90ecc7f4 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:09.998785 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:10.018179 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143cc4d-3b62-4bba-a2c4-a5e690c83401 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:10.072304 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:10.077957 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ce0d4-6870-4970-85e5-8a3f90ecc7f4 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:10.114755 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b49f7-47cd-4ecf-a69d-4c2d1293456e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:10.115806 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b49f7-47cd-4ecf-a69d-4c2d1293456e None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:10.116097 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b49f7-47cd-4ecf-a69d-4c2d1293456e None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:10.116378 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b49f7-47cd-4ecf-a69d-4c2d1293456e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:10.127003 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b49f7-47cd-4ecf-a69d-4c2d1293456e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:38:10.127942 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143cc4d-3b62-4bba-a2c4-a5e690c83401 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:10.131940 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-2d7b49f7-47cd-4ecf-a69d-4c2d1293456e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:38:10.131940 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:10.131940 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:10.131940 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:10.131940 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:10.131940 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:10.131940 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:10.131940 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:10.131940 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:10.131940 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:10.131940 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:10.131940 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:10.131940 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:38:10.131940 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:38:10.131940 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:38:10.131940 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:38:10.132924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:38:10.132924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:38:10.132924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:38:10.132924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:38:10.132924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:10.132924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:10.132924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:10.132924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:10.132924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:10.132924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:10.132924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:10.132924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:10.132924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:10.132924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:10.132924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:10.132924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:10.133836 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:10.133836 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:10.133836 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:10.133836 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:10.133836 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:38:10.133836 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:38:10.133836 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:38:10.133836 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:38:10.133836 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:38:10.133836 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:38:10.133836 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:38:10.133836 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:38:10.133836 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 26/51] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 27 09:38:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:38:10.140624 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b49f7-47cd-4ecf-a69d-4c2d1293456e None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:10.170362 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208aed0-6f85-46a8-8334-0aa16a74ac77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:10.171036 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208aed0-6f85-46a8-8334-0aa16a74ac77 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:10.171316 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208aed0-6f85-46a8-8334-0aa16a74ac77 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:10.171593 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208aed0-6f85-46a8-8334-0aa16a74ac77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:10.174142 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208aed0-6f85-46a8-8334-0aa16a74ac77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:10.175680 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208aed0-6f85-46a8-8334-0aa16a74ac77 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:10.177525 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 26/52] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:38:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:10.183167 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208aed0-6f85-46a8-8334-0aa16a74ac77 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:10.248073 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:10.255268 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b49f7-47cd-4ecf-a69d-4c2d1293456e None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:10.290967 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c186b3-481a-4a69-bcc6-9ef889a5ca60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:10.291192 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208aed0-6f85-46a8-8334-0aa16a74ac77 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:10.291587 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c186b3-481a-4a69-bcc6-9ef889a5ca60 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:10.291866 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c186b3-481a-4a69-bcc6-9ef889a5ca60 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:10.292137 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c186b3-481a-4a69-bcc6-9ef889a5ca60 None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:10.292795 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c186b3-481a-4a69-bcc6-9ef889a5ca60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:10.293095 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c186b3-481a-4a69-bcc6-9ef889a5ca60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:10.294513 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c186b3-481a-4a69-bcc6-9ef889a5ca60 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:10.303657 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 27/53] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:38:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:38:10.309186 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:10.309336 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c186b3-481a-4a69-bcc6-9ef889a5ca60 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:10.328099 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67061d-bc92-4907-98af-67b3bf83c889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:10.328710 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67061d-bc92-4907-98af-67b3bf83c889 None admin] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:10.328983 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67061d-bc92-4907-98af-67b3bf83c889 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:10.329242 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67061d-bc92-4907-98af-67b3bf83c889 None admin] PATH_INFO: `/v3/projects` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:10.329904 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67061d-bc92-4907-98af-67b3bf83c889 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:10.331431 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67061d-bc92-4907-98af-67b3bf83c889 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:10.361188 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 27/54] 10.222.0.49 () {60 vars in 1140 bytes} [Tue Sep 27 09:38:10 2022] POST /identity/v3/projects => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 09:38:10.419477 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c186b3-481a-4a69-bcc6-9ef889a5ca60 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:10.457935 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01566b-8694-469f-ba1c-6d17e1f2e5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:10.458601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01566b-8694-469f-ba1c-6d17e1f2e5a2 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:10.458896 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01566b-8694-469f-ba1c-6d17e1f2e5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:10.459229 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01566b-8694-469f-ba1c-6d17e1f2e5a2 None admin] PATH_INFO: `/v3/users/e6a28914e72f4ed6b89baeb8d519808a` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:10.460622 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01566b-8694-469f-ba1c-6d17e1f2e5a2 None admin] RBAC: Authorizing `identity:get_user(user_id=e6a28914e72f4ed6b89baeb8d519808a)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:10.462124 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01566b-8694-469f-ba1c-6d17e1f2e5a2 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:10.463857 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 28/55] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:38:10 2022] GET /identity/v3/users/e6a28914e72f4ed6b89baeb8d519808a => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:38:10.469842 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67061d-bc92-4907-98af-67b3bf83c889 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:10.583865 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67061d-bc92-4907-98af-67b3bf83c889 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:10.621723 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c7f25-5202-4189-aa6d-10921f298278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:10.622378 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c7f25-5202-4189-aa6d-10921f298278 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:10.622661 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c7f25-5202-4189-aa6d-10921f298278 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:10.622973 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c7f25-5202-4189-aa6d-10921f298278 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:10.624109 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c7f25-5202-4189-aa6d-10921f298278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:10.625567 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c7f25-5202-4189-aa6d-10921f298278 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:10.627213 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 28/56] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:38:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:10.633389 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01566b-8694-469f-ba1c-6d17e1f2e5a2 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:10.659924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:10.739088 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01566b-8694-469f-ba1c-6d17e1f2e5a2 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:10.773108 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c93261-8fb6-4d11-9cf1-b4a11c556a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:10.773733 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c93261-8fb6-4d11-9cf1-b4a11c556a70 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:10.773999 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c93261-8fb6-4d11-9cf1-b4a11c556a70 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:10.774272 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c93261-8fb6-4d11-9cf1-b4a11c556a70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:10.775049 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c93261-8fb6-4d11-9cf1-b4a11c556a70 None admin] RBAC: Adding query filter params (role.id=7cc7d3c85c794033b590117321e97ccf, scope.domain.id=default, user.id=e6a28914e72f4ed6b89baeb8d519808a) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:10.775359 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c93261-8fb6-4d11-9cf1-b4a11c556a70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:10.776828 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c93261-8fb6-4d11-9cf1-b4a11c556a70 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:10.786715 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 29/57] 10.222.0.49 () {56 vars in 1322 bytes} [Tue Sep 27 09:38:10 2022] GET /identity/v3/role_assignments?user.id=e6a28914e72f4ed6b89baeb8d519808a&scope.domain.id=default&role.id=7cc7d3c85c794033b590117321e97ccf => generated 530 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:12.845077 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047c17d-41b9-48e5-810e-bf7acf589673 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:12.845605 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047c17d-41b9-48e5-810e-bf7acf589673 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:12.845605 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047c17d-41b9-48e5-810e-bf7acf589673 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:12.846903 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 29/58] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:12.852915 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ca142-0432-4386-9821-e0ddffcc41ce None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:12.853430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ca142-0432-4386-9821-e0ddffcc41ce None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:12.853515 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ca142-0432-4386-9821-e0ddffcc41ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:12.873244 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-f08ca142-0432-4386-9821-e0ddffcc41ce None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:12.874569 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-f08ca142-0432-4386-9821-e0ddffcc41ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:12.941872 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 30/59] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:13.269792 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047c17d-41b9-48e5-810e-bf7acf589673 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:13.310130 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:13.381158 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047c17d-41b9-48e5-810e-bf7acf589673 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:13.420109 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf4d3e-e200-4e00-81c8-96a0006e2a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:13.420746 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf4d3e-e200-4e00-81c8-96a0006e2a35 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:13.421029 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf4d3e-e200-4e00-81c8-96a0006e2a35 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:13.421302 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf4d3e-e200-4e00-81c8-96a0006e2a35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:13.422482 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf4d3e-e200-4e00-81c8-96a0006e2a35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:13.423989 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf4d3e-e200-4e00-81c8-96a0006e2a35 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:13.425573 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 30/60] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:38:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:13.431536 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ca142-0432-4386-9821-e0ddffcc41ce None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:13.450385 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:13.533602 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ca142-0432-4386-9821-e0ddffcc41ce None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:13.569127 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13f65e-4ed8-47ac-bd99-23f7ab187ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:13.569759 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13f65e-4ed8-47ac-bd99-23f7ab187ef2 None admin] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:13.570051 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13f65e-4ed8-47ac-bd99-23f7ab187ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:13.570322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13f65e-4ed8-47ac-bd99-23f7ab187ef2 None admin] PATH_INFO: `/v3/users` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:13.571004 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13f65e-4ed8-47ac-bd99-23f7ab187ef2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:13.572513 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13f65e-4ed8-47ac-bd99-23f7ab187ef2 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:13.604088 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 31/61] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 27 09:38:13 2022] POST /identity/v3/users => generated 275 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:38:17.216336 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945734bc-0fdc-42af-b981-1e35709618e9 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:17.216891 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945734bc-0fdc-42af-b981-1e35709618e9 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:17.216891 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945734bc-0fdc-42af-b981-1e35709618e9 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:17.218370 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 31/62] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:17.224319 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6810c4d-5676-480f-9bb8-7564f5e102d3 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:17.225280 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6810c4d-5676-480f-9bb8-7564f5e102d3 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:17.225742 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6810c4d-5676-480f-9bb8-7564f5e102d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:17.252620 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-d6810c4d-5676-480f-9bb8-7564f5e102d3 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:17.254231 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-d6810c4d-5676-480f-9bb8-7564f5e102d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:17.299011 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c0fe3-a5a5-4476-8b0b-85bf4e5c4115 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:17.299637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c0fe3-a5a5-4476-8b0b-85bf4e5c4115 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:17.300096 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c0fe3-a5a5-4476-8b0b-85bf4e5c4115 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:17.301742 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 32/63] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:38:17.309109 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae5c4f-e090-49e8-ba91-ee8d69a70fc0 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:17.310134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae5c4f-e090-49e8-ba91-ee8d69a70fc0 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:17.310657 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae5c4f-e090-49e8-ba91-ee8d69a70fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:17.350971 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-2dae5c4f-e090-49e8-ba91-ee8d69a70fc0 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:17.352265 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-2dae5c4f-e090-49e8-ba91-ee8d69a70fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:17.387459 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 32/64] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 09:38:17.476496 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 33/65] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:17.846393 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b4ad4-92d7-4027-8cdd-910031dad53e None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:17.846815 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b4ad4-92d7-4027-8cdd-910031dad53e None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:17.846993 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b4ad4-92d7-4027-8cdd-910031dad53e None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:17.848342 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 33/66] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:17.854627 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9053150-e701-45d3-83ac-1d432478414f None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:17.854934 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9053150-e701-45d3-83ac-1d432478414f None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:17.855434 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9053150-e701-45d3-83ac-1d432478414f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:17.875880 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-b9053150-e701-45d3-83ac-1d432478414f None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:17.877516 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-b9053150-e701-45d3-83ac-1d432478414f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:17.899419 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b4ad4-92d7-4027-8cdd-910031dad53e None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:17.904452 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:17.913577 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:17.960054 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 34/67] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:17.962998 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a2b2f-c38f-4895-b63b-9ddb105819e0 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:17.962998 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a2b2f-c38f-4895-b63b-9ddb105819e0 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:17.962998 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a2b2f-c38f-4895-b63b-9ddb105819e0 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:17.963302 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 35/68] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:17.965759 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a2b2f-c38f-4895-b63b-9ddb105819e0 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:18.031340 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b4ad4-92d7-4027-8cdd-910031dad53e None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:18.071815 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae6011-f7b1-4ed3-8122-c66e428e07d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:18.072824 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae6011-f7b1-4ed3-8122-c66e428e07d3 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:18.073376 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae6011-f7b1-4ed3-8122-c66e428e07d3 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:18.073843 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae6011-f7b1-4ed3-8122-c66e428e07d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:18.083510 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a2b2f-c38f-4895-b63b-9ddb105819e0 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:18.087160 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae6011-f7b1-4ed3-8122-c66e428e07d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:38:18.093151 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-6cae6011-f7b1-4ed3-8122-c66e428e07d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:38:18.093151 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:18.093151 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:18.093151 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:18.093151 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:18.093151 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:18.093151 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:18.093151 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:18.093151 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:18.093151 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:18.093151 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:18.093151 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:18.093151 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:38:18.093151 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:38:18.093151 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:38:18.093151 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:38:18.094042 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:38:18.094042 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:38:18.094042 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:38:18.094042 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:38:18.094042 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:18.094042 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:18.094042 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:18.094042 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:18.094042 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:18.094042 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:18.094042 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:18.094042 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:18.094042 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:18.094042 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:18.094042 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:18.094042 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:18.094808 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:18.094808 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:18.094808 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:18.094808 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:18.094808 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:38:18.094808 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:38:18.094808 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:38:18.094808 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:38:18.094808 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:38:18.094808 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:38:18.094808 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:38:18.094808 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:38:18.097318 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 34/69] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:38:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:38:18.098958 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cb9fa-1050-48bc-b54c-d68e142b7fbf None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:18.099469 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cb9fa-1050-48bc-b54c-d68e142b7fbf None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:18.099995 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cb9fa-1050-48bc-b54c-d68e142b7fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:18.120654 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-392cb9fa-1050-48bc-b54c-d68e142b7fbf None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:18.121993 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-392cb9fa-1050-48bc-b54c-d68e142b7fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:18.128935 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f3ae2-3530-4036-ac8b-76c4e988c9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:18.129590 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f3ae2-3530-4036-ac8b-76c4e988c9f7 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:18.129872 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f3ae2-3530-4036-ac8b-76c4e988c9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:18.130147 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f3ae2-3530-4036-ac8b-76c4e988c9f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:18.142165 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f3ae2-3530-4036-ac8b-76c4e988c9f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:38:18.148464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-e27f3ae2-3530-4036-ac8b-76c4e988c9f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:38:18.148464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:18.148464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:18.148464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:18.148464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:18.148464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:18.148464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:18.148464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:18.148464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:18.148464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:18.148464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:18.148464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:18.148464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:38:18.148464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:38:18.148464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:38:18.148464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:38:18.149561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:38:18.149561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:38:18.149561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:38:18.149561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:38:18.149561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:18.149561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:18.149561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:18.149561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:18.149561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:18.149561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:18.149561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:18.149561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:18.149561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:18.149561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:18.149561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:18.149561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:18.150493 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:18.150493 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:18.150493 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:18.150493 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:18.150493 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:38:18.150493 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:38:18.150493 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:38:18.150493 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:38:18.150493 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:38:18.150493 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:38:18.150493 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:38:18.150493 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:38:18.154659 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 36/70] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 27 09:38:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:38:18.155626 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f3ae2-3530-4036-ac8b-76c4e988c9f7 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:18.185536 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:18.191786 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:18.214803 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 35/71] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:18.214803 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bcc6f-ce92-4266-9d47-b8f68a7f9155 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:18.214803 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bcc6f-ce92-4266-9d47-b8f68a7f9155 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:18.214803 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bcc6f-ce92-4266-9d47-b8f68a7f9155 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:18.215187 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 36/72] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:18.215781 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0bcc6f-ce92-4266-9d47-b8f68a7f9155 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:18.276101 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f3ae2-3530-4036-ac8b-76c4e988c9f7 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:18.315683 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f6ffc-a054-490c-88ee-a41ed9c13a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:18.316606 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f6ffc-a054-490c-88ee-a41ed9c13a21 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:18.317033 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f6ffc-a054-490c-88ee-a41ed9c13a21 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:18.317302 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f6ffc-a054-490c-88ee-a41ed9c13a21 None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:18.317987 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f6ffc-a054-490c-88ee-a41ed9c13a21 None admin] RBAC: Adding query filter params (name=member) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:18.318488 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f6ffc-a054-490c-88ee-a41ed9c13a21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:18.320331 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f6ffc-a054-490c-88ee-a41ed9c13a21 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:18.328060 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0bcc6f-ce92-4266-9d47-b8f68a7f9155 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:18.331741 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 37/73] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 27 09:38:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:18.332292 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bae837-a2b9-40d9-9e29-e1ff07f48ac5 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:18.332582 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bae837-a2b9-40d9-9e29-e1ff07f48ac5 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:18.332874 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bae837-a2b9-40d9-9e29-e1ff07f48ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:18.354893 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-82bae837-a2b9-40d9-9e29-e1ff07f48ac5 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:18.355969 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-82bae837-a2b9-40d9-9e29-e1ff07f48ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:18.380191 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e59d9a-7a40-4a69-a1be-d75ca321148d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:18.381525 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e59d9a-7a40-4a69-a1be-d75ca321148d None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:18.382147 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e59d9a-7a40-4a69-a1be-d75ca321148d None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:18.382423 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e59d9a-7a40-4a69-a1be-d75ca321148d None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:18.383140 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e59d9a-7a40-4a69-a1be-d75ca321148d None admin] RBAC: Adding query filter params (name=admin) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:18.383443 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e59d9a-7a40-4a69-a1be-d75ca321148d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:18.384944 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e59d9a-7a40-4a69-a1be-d75ca321148d None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:18.394185 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 37/74] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:38:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:18.394934 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e59d9a-7a40-4a69-a1be-d75ca321148d None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:18.443296 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 38/75] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:18.444472 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bae837-a2b9-40d9-9e29-e1ff07f48ac5 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:18.476596 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:18.483246 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:18.555898 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e59d9a-7a40-4a69-a1be-d75ca321148d None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:18.605407 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1c66b-0a2d-40e6-b276-75cf53a1ae48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:18.605963 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1c66b-0a2d-40e6-b276-75cf53a1ae48 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:18.606744 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1c66b-0a2d-40e6-b276-75cf53a1ae48 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:18.607067 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1c66b-0a2d-40e6-b276-75cf53a1ae48 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:18.617398 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bae837-a2b9-40d9-9e29-e1ff07f48ac5 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:18.622497 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1c66b-0a2d-40e6-b276-75cf53a1ae48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:38:18.629047 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-b4c1c66b-0a2d-40e6-b276-75cf53a1ae48 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:38:18.629047 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:18.629047 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:18.629047 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:18.629047 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:18.629047 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:18.629047 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:18.629047 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:18.629047 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:18.629047 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:18.629047 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:18.629047 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:18.629047 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:38:18.629047 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:38:18.629047 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:38:18.629047 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:38:18.630704 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:38:18.630704 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:38:18.630704 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:38:18.630704 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:38:18.630704 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:18.630704 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:18.630704 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:18.630704 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:18.630704 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:18.630704 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:18.630704 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:18.630704 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:18.630704 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:18.630704 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:18.630704 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:18.630704 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:18.632650 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:18.632650 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:18.632650 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:18.632650 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:18.632650 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:38:18.632650 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:38:18.632650 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:38:18.632650 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:38:18.632650 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:38:18.632650 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:38:18.632650 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:38:18.632650 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:38:18.632650 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 38/76] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:38:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:38:18.632650 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1c66b-0a2d-40e6-b276-75cf53a1ae48 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:18.664900 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c56a6-3806-4e60-b5f9-710e1b96d178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:18.665566 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c56a6-3806-4e60-b5f9-710e1b96d178 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:18.665957 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c56a6-3806-4e60-b5f9-710e1b96d178 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:18.666231 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c56a6-3806-4e60-b5f9-710e1b96d178 None admin] PATH_INFO: `/v3/users/2e0ed9493f0a42aca920506fd4534d15` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:18.682110 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c56a6-3806-4e60-b5f9-710e1b96d178 None admin] RBAC: Authorizing `identity:get_user(user_id=2e0ed9493f0a42aca920506fd4534d15)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:18.683620 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c56a6-3806-4e60-b5f9-710e1b96d178 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:18.691263 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 39/77] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:38:18 2022] GET /identity/v3/users/2e0ed9493f0a42aca920506fd4534d15 => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:18.691263 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c56a6-3806-4e60-b5f9-710e1b96d178 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:18.767510 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1c66b-0a2d-40e6-b276-75cf53a1ae48 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:18.779489 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:18.785738 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:18.804931 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f23aff-d598-4268-8cac-918d43cf9db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:18.805576 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f23aff-d598-4268-8cac-918d43cf9db3 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:18.805864 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f23aff-d598-4268-8cac-918d43cf9db3 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:18.806138 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f23aff-d598-4268-8cac-918d43cf9db3 None admin] PATH_INFO: `/v3/users/e6a28914e72f4ed6b89baeb8d519808a` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:18.807313 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f23aff-d598-4268-8cac-918d43cf9db3 None admin] RBAC: Authorizing `identity:get_user(user_id=e6a28914e72f4ed6b89baeb8d519808a)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:18.808380 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c56a6-3806-4e60-b5f9-710e1b96d178 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:18.808780 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f23aff-d598-4268-8cac-918d43cf9db3 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:18.810415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 39/78] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:38:18 2022] GET /identity/v3/users/e6a28914e72f4ed6b89baeb8d519808a => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:18.811192 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f23aff-d598-4268-8cac-918d43cf9db3 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:18.846876 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b409a1-226b-4a1b-8cf1-3086b1cbe8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:18.847523 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b409a1-226b-4a1b-8cf1-3086b1cbe8cb None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:18.847803 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b409a1-226b-4a1b-8cf1-3086b1cbe8cb None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:18.848082 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b409a1-226b-4a1b-8cf1-3086b1cbe8cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:18.859576 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b409a1-226b-4a1b-8cf1-3086b1cbe8cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:38:18.864387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-e1b409a1-226b-4a1b-8cf1-3086b1cbe8cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 09:38:18.864387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:18.864387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:18.864387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:18.864387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:18.864387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:18.864387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:18.864387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:18.864387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:18.864387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:18.864387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:18.864387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:18.864387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:38:18.864387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:38:18.864387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:38:18.864387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:38:18.866078 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:38:18.866078 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:38:18.866078 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:38:18.866078 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:38:18.866078 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:18.866078 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:18.866078 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:18.866078 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:18.866078 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:18.866078 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:18.866078 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:18.866078 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:18.866078 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:18.866078 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:18.866078 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:18.866078 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:18.867811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:18.867811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:18.867811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:18.867811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:18.867811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:38:18.867811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:38:18.867811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:38:18.867811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:38:18.867811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:38:18.867811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:38:18.867811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 09:38:18.867811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:38:18.870854 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 40/79] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 27 09:38:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:38:18.871727 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b409a1-226b-4a1b-8cf1-3086b1cbe8cb None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:18.919417 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f23aff-d598-4268-8cac-918d43cf9db3 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:18.956700 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95fb5b-001b-441f-a04a-1278b737a535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:18.957459 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95fb5b-001b-441f-a04a-1278b737a535 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:18.957813 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95fb5b-001b-441f-a04a-1278b737a535 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:18.958161 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95fb5b-001b-441f-a04a-1278b737a535 None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:18.958907 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95fb5b-001b-441f-a04a-1278b737a535 None admin] RBAC: Adding query filter params (name=member) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:18.959340 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95fb5b-001b-441f-a04a-1278b737a535 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:18.960792 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95fb5b-001b-441f-a04a-1278b737a535 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:18.970264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 40/80] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 27 09:38:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:18.971145 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95fb5b-001b-441f-a04a-1278b737a535 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:18.982173 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b409a1-226b-4a1b-8cf1-3086b1cbe8cb None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:19.023193 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:19.024087 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a9371-6734-4e46-a2ee-e9e0f7718425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:19.024976 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a9371-6734-4e46-a2ee-e9e0f7718425 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:19.025392 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a9371-6734-4e46-a2ee-e9e0f7718425 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:19.025755 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a9371-6734-4e46-a2ee-e9e0f7718425 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:19.029277 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:19.083534 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95fb5b-001b-441f-a04a-1278b737a535 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:19.102723 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a9371-6734-4e46-a2ee-e9e0f7718425 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:19.104274 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a9371-6734-4e46-a2ee-e9e0f7718425 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:19.124229 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bab70-2b13-4dcb-accf-ff80bde11eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:19.124958 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bab70-2b13-4dcb-accf-ff80bde11eb5 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:19.125315 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bab70-2b13-4dcb-accf-ff80bde11eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:19.125667 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bab70-2b13-4dcb-accf-ff80bde11eb5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:19.127004 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bab70-2b13-4dcb-accf-ff80bde11eb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:19.128541 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bab70-2b13-4dcb-accf-ff80bde11eb5 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:19.130135 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 41/81] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:38:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:19.131029 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bab70-2b13-4dcb-accf-ff80bde11eb5 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:19.220354 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 41/82] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:38:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:38:19.224086 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a9371-6734-4e46-a2ee-e9e0f7718425 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:19.248239 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bab70-2b13-4dcb-accf-ff80bde11eb5 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:19.264498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:19.264941 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:19.288240 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78b560-fd16-483d-b372-7bc20f233e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:19.288872 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78b560-fd16-483d-b372-7bc20f233e5f None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:19.289154 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78b560-fd16-483d-b372-7bc20f233e5f None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:19.289437 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78b560-fd16-483d-b372-7bc20f233e5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:19.343475 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a9371-6734-4e46-a2ee-e9e0f7718425 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:19.364389 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78b560-fd16-483d-b372-7bc20f233e5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:19.366643 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78b560-fd16-483d-b372-7bc20f233e5f None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:19.389432 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8542860-1059-42bb-8447-6a80ab170b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:19.390073 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8542860-1059-42bb-8447-6a80ab170b95 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:19.390429 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8542860-1059-42bb-8447-6a80ab170b95 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:19.390800 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8542860-1059-42bb-8447-6a80ab170b95 None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:19.391759 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8542860-1059-42bb-8447-6a80ab170b95 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:19.392145 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8542860-1059-42bb-8447-6a80ab170b95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:19.393824 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8542860-1059-42bb-8447-6a80ab170b95 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:19.403985 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 42/83] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:38:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:19.405129 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8542860-1059-42bb-8447-6a80ab170b95 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:19.483516 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 42/84] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:38:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:38:19.484888 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78b560-fd16-483d-b372-7bc20f233e5f None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:19.503139 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:19.521436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:19.528081 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8542860-1059-42bb-8447-6a80ab170b95 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:19.567310 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc2923-1ab2-40a7-87c3-c176f11f488f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:19.568073 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc2923-1ab2-40a7-87c3-c176f11f488f None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:19.568459 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc2923-1ab2-40a7-87c3-c176f11f488f None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:19.568844 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc2923-1ab2-40a7-87c3-c176f11f488f None admin] PATH_INFO: `/v3/users/2e0ed9493f0a42aca920506fd4534d15` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:19.570152 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc2923-1ab2-40a7-87c3-c176f11f488f None admin] RBAC: Authorizing `identity:get_user(user_id=2e0ed9493f0a42aca920506fd4534d15)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:19.572049 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc2923-1ab2-40a7-87c3-c176f11f488f None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:19.573838 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 43/85] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:38:19 2022] GET /identity/v3/users/2e0ed9493f0a42aca920506fd4534d15 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:19.574618 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc2923-1ab2-40a7-87c3-c176f11f488f None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:19.601935 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78b560-fd16-483d-b372-7bc20f233e5f None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:19.642226 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2b5f7-641a-41fe-949f-445f893058cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:19.642773 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2b5f7-641a-41fe-949f-445f893058cd None admin] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:19.643073 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2b5f7-641a-41fe-949f-445f893058cd None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:19.643339 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2b5f7-641a-41fe-949f-445f893058cd None admin] PATH_INFO: `/v3/users` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:19.643997 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2b5f7-641a-41fe-949f-445f893058cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:19.645475 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2b5f7-641a-41fe-949f-445f893058cd None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:19.671508 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 43/86] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 27 09:38:19 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:38:19.672541 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2b5f7-641a-41fe-949f-445f893058cd None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:19.704096 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc2923-1ab2-40a7-87c3-c176f11f488f None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:19.749976 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa363e9-9615-4d43-a524-8cacdbb93844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:19.751016 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa363e9-9615-4d43-a524-8cacdbb93844 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:19.751457 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa363e9-9615-4d43-a524-8cacdbb93844 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:19.751910 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa363e9-9615-4d43-a524-8cacdbb93844 None admin] PATH_INFO: `/v3/projects/31d28ae3268846449a1741369164016a` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:19.753785 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa363e9-9615-4d43-a524-8cacdbb93844 None admin] RBAC: Authorizing `identity:get_project(project_id=31d28ae3268846449a1741369164016a)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:19.756391 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa363e9-9615-4d43-a524-8cacdbb93844 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:19.764382 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 44/87] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:38:19 2022] GET /identity/v3/projects/31d28ae3268846449a1741369164016a => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:19.764382 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa363e9-9615-4d43-a524-8cacdbb93844 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:19.784493 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:19.801752 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:19.843218 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2b5f7-641a-41fe-949f-445f893058cd None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:19.885610 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa363e9-9615-4d43-a524-8cacdbb93844 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:19.900019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee23d9-2d0e-43b7-b02c-2e186d9ac6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:19.901250 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee23d9-2d0e-43b7-b02c-2e186d9ac6cf None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:19.901653 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee23d9-2d0e-43b7-b02c-2e186d9ac6cf None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:19.902104 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee23d9-2d0e-43b7-b02c-2e186d9ac6cf None admin] PATH_INFO: `/v3/users/2e0ed9493f0a42aca920506fd4534d15` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:19.906151 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee23d9-2d0e-43b7-b02c-2e186d9ac6cf None admin] RBAC: Authorizing `identity:get_user(user_id=2e0ed9493f0a42aca920506fd4534d15)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:19.909296 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee23d9-2d0e-43b7-b02c-2e186d9ac6cf None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:19.913106 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 44/88] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:38:19 2022] GET /identity/v3/users/2e0ed9493f0a42aca920506fd4534d15 => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:19.914436 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee23d9-2d0e-43b7-b02c-2e186d9ac6cf None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:19.933964 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38485c4d-04d2-470e-ab54-0c8e8a724d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:19.934996 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38485c4d-04d2-470e-ab54-0c8e8a724d64 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:19.936134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38485c4d-04d2-470e-ab54-0c8e8a724d64 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:19.936134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38485c4d-04d2-470e-ab54-0c8e8a724d64 None admin] PATH_INFO: `/v3/projects/31d28ae3268846449a1741369164016a` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:19.937464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38485c4d-04d2-470e-ab54-0c8e8a724d64 None admin] RBAC: Authorizing `identity:get_project(project_id=31d28ae3268846449a1741369164016a)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:19.939178 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38485c4d-04d2-470e-ab54-0c8e8a724d64 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:19.940951 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 45/89] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:38:19 2022] GET /identity/v3/projects/31d28ae3268846449a1741369164016a => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:19.941791 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38485c4d-04d2-470e-ab54-0c8e8a724d64 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:20.068215 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee23d9-2d0e-43b7-b02c-2e186d9ac6cf None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:20.096075 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:20.098860 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38485c4d-04d2-470e-ab54-0c8e8a724d64 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:20.141783 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb6267-5dbf-49d0-9146-af040655614d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:20.142711 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb6267-5dbf-49d0-9146-af040655614d None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:20.143036 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb6267-5dbf-49d0-9146-af040655614d None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:20.143308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb6267-5dbf-49d0-9146-af040655614d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:20.155491 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137a66a-a3de-43ad-95a5-fc93d11a9102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:20.156033 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:20.156930 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137a66a-a3de-43ad-95a5-fc93d11a9102 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:20.157806 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137a66a-a3de-43ad-95a5-fc93d11a9102 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:20.158294 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137a66a-a3de-43ad-95a5-fc93d11a9102 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:20.160090 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137a66a-a3de-43ad-95a5-fc93d11a9102 None admin] RBAC: Adding query filter params (role.id=378cb7fb6a4e4e5e89ab9a0ecb09d86b, scope.project.id=31d28ae3268846449a1741369164016a, user.id=2e0ed9493f0a42aca920506fd4534d15) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:20.161189 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137a66a-a3de-43ad-95a5-fc93d11a9102 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:20.165210 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137a66a-a3de-43ad-95a5-fc93d11a9102 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:20.180726 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 46/90] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:38:19 2022] GET /identity/v3/role_assignments?user.id=2e0ed9493f0a42aca920506fd4534d15&scope.project.id=31d28ae3268846449a1741369164016a&role.id=378cb7fb6a4e4e5e89ab9a0ecb09d86b => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:20.182406 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137a66a-a3de-43ad-95a5-fc93d11a9102 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:20.314804 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb6267-5dbf-49d0-9146-af040655614d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:20.314804 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb6267-5dbf-49d0-9146-af040655614d None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:20.317190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137a66a-a3de-43ad-95a5-fc93d11a9102 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:20.438492 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfafe85-d0a9-410f-b632-c7633e848084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:20.439999 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfafe85-d0a9-410f-b632-c7633e848084 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:20.440469 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfafe85-d0a9-410f-b632-c7633e848084 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:20.440935 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfafe85-d0a9-410f-b632-c7633e848084 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:20.507779 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:20.534693 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 45/91] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:38:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:38:20.536375 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb6267-5dbf-49d0-9146-af040655614d None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:20.571767 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfafe85-d0a9-410f-b632-c7633e848084 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:20.573327 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfafe85-d0a9-410f-b632-c7633e848084 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:20.630287 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:20.764991 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 47/92] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:38:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:38:20.772590 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfafe85-d0a9-410f-b632-c7633e848084 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:20.821205 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb6267-5dbf-49d0-9146-af040655614d None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:20.898410 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:20.930580 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64f1ed-1f13-4c7f-b108-576c2dd12868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:20.931722 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64f1ed-1f13-4c7f-b108-576c2dd12868 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:20.932195 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64f1ed-1f13-4c7f-b108-576c2dd12868 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:20.932652 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64f1ed-1f13-4c7f-b108-576c2dd12868 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:20.933670 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64f1ed-1f13-4c7f-b108-576c2dd12868 None admin] RBAC: Adding query filter params (role.id=7cc7d3c85c794033b590117321e97ccf, scope.project.id=31d28ae3268846449a1741369164016a, user.id=e6a28914e72f4ed6b89baeb8d519808a) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:20.934187 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64f1ed-1f13-4c7f-b108-576c2dd12868 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:20.935897 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64f1ed-1f13-4c7f-b108-576c2dd12868 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:20.950336 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 46/93] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:38:20 2022] GET /identity/v3/role_assignments?user.id=e6a28914e72f4ed6b89baeb8d519808a&scope.project.id=31d28ae3268846449a1741369164016a&role.id=7cc7d3c85c794033b590117321e97ccf => generated 259 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:20.951776 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64f1ed-1f13-4c7f-b108-576c2dd12868 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:20.971734 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfafe85-d0a9-410f-b632-c7633e848084 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:21.036811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf62a2-f444-4aa3-8bc2-02ece25416a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:21.037766 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf62a2-f444-4aa3-8bc2-02ece25416a3 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:21.038191 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf62a2-f444-4aa3-8bc2-02ece25416a3 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:21.038596 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf62a2-f444-4aa3-8bc2-02ece25416a3 None admin] PATH_INFO: `/v3/projects/5b7777d2d99e4b62a0f549fa37ee4827` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:21.040758 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf62a2-f444-4aa3-8bc2-02ece25416a3 None admin] RBAC: Authorizing `identity:get_project(project_id=5b7777d2d99e4b62a0f549fa37ee4827)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:21.043358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf62a2-f444-4aa3-8bc2-02ece25416a3 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:21.047058 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 48/94] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:38:20 2022] GET /identity/v3/projects/5b7777d2d99e4b62a0f549fa37ee4827 => generated 312 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:21.055217 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf62a2-f444-4aa3-8bc2-02ece25416a3 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:21.245251 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64f1ed-1f13-4c7f-b108-576c2dd12868 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:21.247213 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:21.295937 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf62a2-f444-4aa3-8bc2-02ece25416a3 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:21.352193 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f512955-7233-469e-8652-d052f6ff7324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:21.352863 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f512955-7233-469e-8652-d052f6ff7324 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:21.353148 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f512955-7233-469e-8652-d052f6ff7324 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:21.353427 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f512955-7233-469e-8652-d052f6ff7324 None admin] PATH_INFO: `/v3/projects/31d28ae3268846449a1741369164016a` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:21.359638 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f512955-7233-469e-8652-d052f6ff7324 None admin] RBAC: Authorizing `identity:get_project(project_id=31d28ae3268846449a1741369164016a)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:21.360616 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:21.361188 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f512955-7233-469e-8652-d052f6ff7324 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:21.363231 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 47/95] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:38:20 2022] GET /identity/v3/projects/31d28ae3268846449a1741369164016a => generated 298 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:21.367540 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc543083-5e25-4372-a67d-a4f49b25fd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:21.368593 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc543083-5e25-4372-a67d-a4f49b25fd6f None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:21.369200 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc543083-5e25-4372-a67d-a4f49b25fd6f None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:21.369633 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc543083-5e25-4372-a67d-a4f49b25fd6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:21.370171 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f512955-7233-469e-8652-d052f6ff7324 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:21.371011 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc543083-5e25-4372-a67d-a4f49b25fd6f None admin] RBAC: Adding query filter params (role.id=378cb7fb6a4e4e5e89ab9a0ecb09d86b, scope.project.id=5b7777d2d99e4b62a0f549fa37ee4827, user.id=2e0ed9493f0a42aca920506fd4534d15) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:21.371499 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc543083-5e25-4372-a67d-a4f49b25fd6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:21.374442 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc543083-5e25-4372-a67d-a4f49b25fd6f None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:21.394917 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 49/96] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:38:21 2022] GET /identity/v3/role_assignments?user.id=2e0ed9493f0a42aca920506fd4534d15&scope.project.id=5b7777d2d99e4b62a0f549fa37ee4827&role.id=378cb7fb6a4e4e5e89ab9a0ecb09d86b => generated 259 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:21.526187 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f512955-7233-469e-8652-d052f6ff7324 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:21.573380 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f1dcf-e91b-4ffe-b4e4-707343ef23cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:21.574005 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f1dcf-e91b-4ffe-b4e4-707343ef23cc None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:21.574263 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f1dcf-e91b-4ffe-b4e4-707343ef23cc None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:21.574557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f1dcf-e91b-4ffe-b4e4-707343ef23cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:21.575351 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f1dcf-e91b-4ffe-b4e4-707343ef23cc None admin] RBAC: Adding query filter params (role.id=3c0df08d0ed0435597a1d69ed45a49d4, scope.project.id=31d28ae3268846449a1741369164016a, user.id=2e0ed9493f0a42aca920506fd4534d15) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:21.575664 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f1dcf-e91b-4ffe-b4e4-707343ef23cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:21.577188 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f1dcf-e91b-4ffe-b4e4-707343ef23cc None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:21.592747 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 48/97] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:38:21 2022] GET /identity/v3/role_assignments?user.id=2e0ed9493f0a42aca920506fd4534d15&scope.project.id=31d28ae3268846449a1741369164016a&role.id=3c0df08d0ed0435597a1d69ed45a49d4 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:23.281621 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fda95-ad1f-4a65-bab4-9b4ac7a71ef1 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:23.282619 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fda95-ad1f-4a65-bab4-9b4ac7a71ef1 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:23.283143 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fda95-ad1f-4a65-bab4-9b4ac7a71ef1 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:23.284779 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 50/98] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:23.291433 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46303b7-15d7-40de-971a-bab289dd105b None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:23.291949 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46303b7-15d7-40de-971a-bab289dd105b None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:23.292054 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46303b7-15d7-40de-971a-bab289dd105b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:23.315958 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-a46303b7-15d7-40de-971a-bab289dd105b None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:23.317241 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-a46303b7-15d7-40de-971a-bab289dd105b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:23.356278 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:23.421536 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 49/99] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:24.158130 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82fda95-ad1f-4a65-bab4-9b4ac7a71ef1 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:24.269129 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18705b-4b21-4e40-9ebb-bbc0ec12f434 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:24.270559 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18705b-4b21-4e40-9ebb-bbc0ec12f434 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:24.271070 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18705b-4b21-4e40-9ebb-bbc0ec12f434 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:24.273155 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 50/100] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:24.274960 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db8c0e-de50-42ce-ac22-b2d025788f55 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:24.275752 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db8c0e-de50-42ce-ac22-b2d025788f55 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:24.276498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db8c0e-de50-42ce-ac22-b2d025788f55 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:24.279539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 51/101] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:24.282806 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775465ca-a39f-4ca2-8ee5-2a5b190622b9 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:24.283626 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775465ca-a39f-4ca2-8ee5-2a5b190622b9 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:24.284216 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775465ca-a39f-4ca2-8ee5-2a5b190622b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:24.326648 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-775465ca-a39f-4ca2-8ee5-2a5b190622b9 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:24.327904 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-775465ca-a39f-4ca2-8ee5-2a5b190622b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:24.371628 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82fda95-ad1f-4a65-bab4-9b4ac7a71ef1 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:24.421572 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc1834-acf8-45ff-b60d-377e3500a456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:24.422584 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc1834-acf8-45ff-b60d-377e3500a456 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:24.423105 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc1834-acf8-45ff-b60d-377e3500a456 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:24.423543 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc1834-acf8-45ff-b60d-377e3500a456 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:24.426967 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc1834-acf8-45ff-b60d-377e3500a456 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:24.435238 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc1834-acf8-45ff-b60d-377e3500a456 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:24.438433 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 51/102] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:38:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:24.445825 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4276c-5add-4c0b-ad2a-6385a0a8cd44 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:24.446751 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4276c-5add-4c0b-ad2a-6385a0a8cd44 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:24.447374 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4276c-5add-4c0b-ad2a-6385a0a8cd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:24.507940 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-04e4276c-5add-4c0b-ad2a-6385a0a8cd44 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:24.509178 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-04e4276c-5add-4c0b-ad2a-6385a0a8cd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:24.526565 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 52/103] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:24.527954 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775465ca-a39f-4ca2-8ee5-2a5b190622b9 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:24.616530 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:24.629424 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 52/104] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:24.721521 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:24.733901 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775465ca-a39f-4ca2-8ee5-2a5b190622b9 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:24.795062 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099a397-0573-46e8-b0a3-d5f797f57f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:24.795690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099a397-0573-46e8-b0a3-d5f797f57f04 None admin] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:24.795965 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099a397-0573-46e8-b0a3-d5f797f57f04 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:24.796232 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099a397-0573-46e8-b0a3-d5f797f57f04 None admin] PATH_INFO: `/v3/projects` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:24.796895 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099a397-0573-46e8-b0a3-d5f797f57f04 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:24.798364 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099a397-0573-46e8-b0a3-d5f797f57f04 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:24.841904 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 53/105] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Sep 27 09:38:24 2022] POST /identity/v3/projects => generated 302 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:38:25.184565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4276c-5add-4c0b-ad2a-6385a0a8cd44 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:25.334796 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4276c-5add-4c0b-ad2a-6385a0a8cd44 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:25.358057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099a397-0573-46e8-b0a3-d5f797f57f04 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:25.387318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d26475-82b6-4864-99b9-9d621ba1680a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:25.388161 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d26475-82b6-4864-99b9-9d621ba1680a None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:25.388453 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d26475-82b6-4864-99b9-9d621ba1680a None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:25.388729 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d26475-82b6-4864-99b9-9d621ba1680a None admin] PATH_INFO: `/v3/roles/member` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:25.410874 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d26475-82b6-4864-99b9-9d621ba1680a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:38:25.416024 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-69d26475-82b6-4864-99b9-9d621ba1680a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:38:25.416024 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:25.416024 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:25.416024 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:25.416024 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:25.416024 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:25.416024 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:25.416024 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:25.416024 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:25.416024 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:25.416024 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:25.416024 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:25.416024 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:38:25.416024 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:38:25.416024 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:38:25.416024 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:38:25.416965 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:38:25.416965 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:38:25.416965 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:38:25.416965 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:38:25.416965 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:25.416965 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:25.416965 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:25.416965 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:25.416965 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:25.416965 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:25.416965 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:25.416965 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:25.416965 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:25.416965 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:25.416965 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:25.416965 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:25.417732 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:25.417732 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:25.417732 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:25.417732 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:25.417732 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:38:25.417732 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:38:25.417732 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:38:25.417732 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:38:25.417732 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:38:25.417732 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:38:25.417732 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:38:25.417732 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:38:25.417732 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 53/106] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:38:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 09:38:25.425371 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d26475-82b6-4864-99b9-9d621ba1680a None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:25.560107 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:25.581685 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099a397-0573-46e8-b0a3-d5f797f57f04 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:25.656913 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d5e83-3b31-4f8c-b764-f6c1139b966a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:25.657678 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d5e83-3b31-4f8c-b764-f6c1139b966a None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:25.658166 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d5e83-3b31-4f8c-b764-f6c1139b966a None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:25.658626 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d5e83-3b31-4f8c-b764-f6c1139b966a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:25.665784 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d26475-82b6-4864-99b9-9d621ba1680a None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:25.673128 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d5e83-3b31-4f8c-b764-f6c1139b966a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:38:25.679111 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-743d5e83-3b31-4f8c-b764-f6c1139b966a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 09:38:25.679111 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:25.679111 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:25.679111 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:25.679111 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:25.679111 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:25.679111 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:25.679111 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:25.679111 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:25.679111 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:25.679111 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:25.679111 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:25.679111 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:38:25.679111 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:38:25.679111 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:38:25.679111 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:38:25.680630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:38:25.680630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:38:25.680630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:38:25.680630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:38:25.680630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:25.680630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:25.680630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:25.680630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:25.680630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:25.680630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:25.680630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:25.680630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:25.680630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:25.680630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:25.680630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:25.680630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:25.681929 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:25.681929 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:25.681929 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:25.681929 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:25.681929 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:38:25.681929 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:38:25.681929 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:38:25.681929 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:38:25.681929 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:38:25.681929 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:38:25.681929 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 09:38:25.681929 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:38:25.681929 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 54/107] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:38:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:38:25.681929 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a773e-56b0-4000-b34f-46d75086ffe6 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:25.688702 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a773e-56b0-4000-b34f-46d75086ffe6 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:25.688702 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a773e-56b0-4000-b34f-46d75086ffe6 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:25.688702 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 55/108] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:25.697114 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22d7bd-bb36-4bd5-8956-f6b9e22667df None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:25.697384 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22d7bd-bb36-4bd5-8956-f6b9e22667df None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:25.697687 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22d7bd-bb36-4bd5-8956-f6b9e22667df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:25.715724 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:25.723103 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-4d22d7bd-bb36-4bd5-8956-f6b9e22667df None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:25.726662 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-4d22d7bd-bb36-4bd5-8956-f6b9e22667df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:25.748858 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ba012-9170-4ccd-a93b-eabab34deabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:25.749821 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ba012-9170-4ccd-a93b-eabab34deabe None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:25.750266 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ba012-9170-4ccd-a93b-eabab34deabe None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:25.750698 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ba012-9170-4ccd-a93b-eabab34deabe None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:25.751877 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ba012-9170-4ccd-a93b-eabab34deabe None admin] RBAC: Adding query filter params (name=member) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:25.752354 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ba012-9170-4ccd-a93b-eabab34deabe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:25.754838 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ba012-9170-4ccd-a93b-eabab34deabe None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:25.769930 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 54/109] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 27 09:38:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:38:25.771670 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ba012-9170-4ccd-a93b-eabab34deabe None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:25.819605 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 56/110] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 09:38:25.819605 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff588f-540c-4b87-a0bf-7fb1b6db7ce6 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:25.819605 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff588f-540c-4b87-a0bf-7fb1b6db7ce6 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:25.819605 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff588f-540c-4b87-a0bf-7fb1b6db7ce6 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:25.819605 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 57/111] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:25.820107 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff588f-540c-4b87-a0bf-7fb1b6db7ce6 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:25.924926 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ba012-9170-4ccd-a93b-eabab34deabe None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:25.951239 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:25.953979 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff588f-540c-4b87-a0bf-7fb1b6db7ce6 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:25.971058 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6464053-ff18-4893-bacc-4ac794a5076a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:25.973911 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6464053-ff18-4893-bacc-4ac794a5076a None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:25.974198 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6464053-ff18-4893-bacc-4ac794a5076a None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:25.974477 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6464053-ff18-4893-bacc-4ac794a5076a None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:25.975490 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6464053-ff18-4893-bacc-4ac794a5076a None admin] RBAC: Adding query filter params (name=reader) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:25.976028 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6464053-ff18-4893-bacc-4ac794a5076a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:25.977564 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6464053-ff18-4893-bacc-4ac794a5076a None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:25.987982 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 55/112] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 27 09:38:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:25.989489 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a05cc1-02e4-433f-9ae5-d90edf14e6f2 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:25.989779 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a05cc1-02e4-433f-9ae5-d90edf14e6f2 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:25.990058 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a05cc1-02e4-433f-9ae5-d90edf14e6f2 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:25.991827 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 56/113] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:25.992839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71303ade-1db2-4bab-a82f-8c199982f27f None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:25.993121 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71303ade-1db2-4bab-a82f-8c199982f27f None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:25.993394 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71303ade-1db2-4bab-a82f-8c199982f27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:26.005873 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47812dd5-a33f-4089-a516-bee2cd7cea4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:26.007380 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47812dd5-a33f-4089-a516-bee2cd7cea4d None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:26.007666 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47812dd5-a33f-4089-a516-bee2cd7cea4d None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:26.007943 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47812dd5-a33f-4089-a516-bee2cd7cea4d None admin] PATH_INFO: `/v3/users/2e0ed9493f0a42aca920506fd4534d15` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:26.011644 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47812dd5-a33f-4089-a516-bee2cd7cea4d None admin] RBAC: Authorizing `identity:get_user(user_id=2e0ed9493f0a42aca920506fd4534d15)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:26.013156 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47812dd5-a33f-4089-a516-bee2cd7cea4d None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:26.016245 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 58/114] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:38:25 2022] GET /identity/v3/users/2e0ed9493f0a42aca920506fd4534d15 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:26.016934 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47812dd5-a33f-4089-a516-bee2cd7cea4d None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:26.020237 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-71303ade-1db2-4bab-a82f-8c199982f27f None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:26.022132 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-71303ade-1db2-4bab-a82f-8c199982f27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:26.029497 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:26.107138 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 57/115] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:26.111920 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39180178-b532-4de4-9e6b-fc8e3fdd9ea0 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:26.111920 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39180178-b532-4de4-9e6b-fc8e3fdd9ea0 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:26.111920 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39180178-b532-4de4-9e6b-fc8e3fdd9ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:26.138288 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-39180178-b532-4de4-9e6b-fc8e3fdd9ea0 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:26.139562 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-39180178-b532-4de4-9e6b-fc8e3fdd9ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:26.237396 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47812dd5-a33f-4089-a516-bee2cd7cea4d None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:26.261225 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 58/116] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:26.262985 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39180178-b532-4de4-9e6b-fc8e3fdd9ea0 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:26.291835 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e91666-b4b1-4c00-8cad-adae67152426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:26.292188 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e91666-b4b1-4c00-8cad-adae67152426 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:26.292469 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e91666-b4b1-4c00-8cad-adae67152426 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:26.292747 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e91666-b4b1-4c00-8cad-adae67152426 None admin] PATH_INFO: `/v3/users/dca8acb99fe7491985b476b5c0d693fc` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:26.343734 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:26.347464 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e91666-b4b1-4c00-8cad-adae67152426 None admin] RBAC: Authorizing `identity:get_user(user_id=dca8acb99fe7491985b476b5c0d693fc)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:26.351002 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e91666-b4b1-4c00-8cad-adae67152426 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:26.354196 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 59/117] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:38:26 2022] GET /identity/v3/users/dca8acb99fe7491985b476b5c0d693fc => generated 289 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:26.361320 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e91666-b4b1-4c00-8cad-adae67152426 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:26.507674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39180178-b532-4de4-9e6b-fc8e3fdd9ea0 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:26.511931 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:26.604791 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d0b0b-13c2-49c4-b8fb-32092956287c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:26.605803 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d0b0b-13c2-49c4-b8fb-32092956287c None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:26.606171 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d0b0b-13c2-49c4-b8fb-32092956287c None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:26.606556 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d0b0b-13c2-49c4-b8fb-32092956287c None admin] PATH_INFO: `/v3/projects/31d28ae3268846449a1741369164016a` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:26.612220 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d0b0b-13c2-49c4-b8fb-32092956287c None admin] RBAC: Authorizing `identity:get_project(project_id=31d28ae3268846449a1741369164016a)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:26.614901 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d0b0b-13c2-49c4-b8fb-32092956287c None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:26.619988 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 59/118] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:38:26 2022] GET /identity/v3/projects/31d28ae3268846449a1741369164016a => generated 298 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:26.621466 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d0b0b-13c2-49c4-b8fb-32092956287c None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:26.622081 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e91666-b4b1-4c00-8cad-adae67152426 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:26.668677 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb675afc-2678-4989-ae9e-31dc32575c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:26.669770 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb675afc-2678-4989-ae9e-31dc32575c5e None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:26.670257 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb675afc-2678-4989-ae9e-31dc32575c5e None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:26.670751 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb675afc-2678-4989-ae9e-31dc32575c5e None admin] PATH_INFO: `/v3/roles/member` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:26.693979 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb675afc-2678-4989-ae9e-31dc32575c5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:38:26.699472 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-eb675afc-2678-4989-ae9e-31dc32575c5e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:38:26.699472 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:26.699472 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:26.699472 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:26.699472 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:26.699472 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:26.699472 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:26.699472 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:26.699472 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:26.699472 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:26.699472 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:26.699472 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:26.699472 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:38:26.699472 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:38:26.699472 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:38:26.699472 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:38:26.700428 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:38:26.700428 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:38:26.700428 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:38:26.700428 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:38:26.700428 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:26.700428 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:26.700428 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:26.700428 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:26.700428 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:26.700428 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:26.700428 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:26.700428 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:26.700428 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:26.700428 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:26.700428 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:26.700428 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:26.701196 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:26.701196 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:26.701196 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:26.701196 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:26.701196 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:38:26.701196 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:38:26.701196 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:38:26.701196 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:38:26.701196 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:38:26.701196 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:38:26.701196 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:38:26.701196 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:38:26.701196 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 60/119] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:38:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:38:26.701802 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb675afc-2678-4989-ae9e-31dc32575c5e None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:26.798846 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d0b0b-13c2-49c4-b8fb-32092956287c None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:26.809067 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:26.842590 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f65e24-93ab-4ca5-895a-ecf1429eb349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:26.843256 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f65e24-93ab-4ca5-895a-ecf1429eb349 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:26.843540 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f65e24-93ab-4ca5-895a-ecf1429eb349 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:26.843847 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f65e24-93ab-4ca5-895a-ecf1429eb349 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:26.844613 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb675afc-2678-4989-ae9e-31dc32575c5e None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:26.877709 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:26.895944 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea70fe-217b-452a-b418-885471ce19fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:26.897277 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea70fe-217b-452a-b418-885471ce19fd None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:26.897804 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea70fe-217b-452a-b418-885471ce19fd None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:26.898319 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea70fe-217b-452a-b418-885471ce19fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:26.913084 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea70fe-217b-452a-b418-885471ce19fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:38:26.919690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-0fea70fe-217b-452a-b418-885471ce19fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 09:38:26.919690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:26.919690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:26.919690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:26.919690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:26.919690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:26.919690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:26.919690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:26.919690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:26.919690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:26.919690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:26.919690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:26.919690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:38:26.919690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:38:26.919690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:38:26.919690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:38:26.921279 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:38:26.921279 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:38:26.921279 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:38:26.921279 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:38:26.921279 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:26.921279 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:26.921279 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:26.921279 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:26.921279 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:26.921279 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:26.921279 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:26.921279 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:26.921279 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:26.921279 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:26.921279 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:26.921279 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:26.923498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:26.923498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:26.923498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:26.923498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:26.923498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:38:26.923498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:38:26.923498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:38:26.923498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:38:26.923498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:38:26.923498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:38:26.923498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 09:38:26.923498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:38:26.923498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 61/120] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 27 09:38:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:38:26.923498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea70fe-217b-452a-b418-885471ce19fd None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:26.941741 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f65e24-93ab-4ca5-895a-ecf1429eb349 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:26.943310 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f65e24-93ab-4ca5-895a-ecf1429eb349 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:27.057526 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea70fe-217b-452a-b418-885471ce19fd None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:27.065171 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 60/121] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:38:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:38:27.066321 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f65e24-93ab-4ca5-895a-ecf1429eb349 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:27.080649 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:27.108008 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e669d-cfd4-42a4-8ee2-607254a66879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:27.108944 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e669d-cfd4-42a4-8ee2-607254a66879 None admin] REQUEST_METHOD: `PUT` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:27.109345 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e669d-cfd4-42a4-8ee2-607254a66879 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:27.109760 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e669d-cfd4-42a4-8ee2-607254a66879 None admin] PATH_INFO: `/v3/projects/31d28ae3268846449a1741369164016a/users/2e0ed9493f0a42aca920506fd4534d15/roles/378cb7fb6a4e4e5e89ab9a0ecb09d86b` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:27.113221 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e669d-cfd4-42a4-8ee2-607254a66879 None admin] RBAC: Authorizing `identity:create_grant(project_id=31d28ae3268846449a1741369164016a, user_id=2e0ed9493f0a42aca920506fd4534d15, role_id=378cb7fb6a4e4e5e89ab9a0ecb09d86b)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:27.114281 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e669d-cfd4-42a4-8ee2-607254a66879 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:27.146891 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 62/122] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 27 09:38:26 2022] PUT /identity/v3/projects/31d28ae3268846449a1741369164016a/users/2e0ed9493f0a42aca920506fd4534d15/roles/378cb7fb6a4e4e5e89ab9a0ecb09d86b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 09:38:27.146891 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e669d-cfd4-42a4-8ee2-607254a66879 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:27.232256 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:27.248074 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f65e24-93ab-4ca5-895a-ecf1429eb349 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:27.327772 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d56c9-ed27-472c-b89b-fa17a24199e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:27.329466 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d56c9-ed27-472c-b89b-fa17a24199e3 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:27.329926 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d56c9-ed27-472c-b89b-fa17a24199e3 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:27.330714 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d56c9-ed27-472c-b89b-fa17a24199e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:27.344748 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e669d-cfd4-42a4-8ee2-607254a66879 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:27.354853 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d56c9-ed27-472c-b89b-fa17a24199e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:38:27.364558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-4a4d56c9-ed27-472c-b89b-fa17a24199e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:38:27.364558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:27.364558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:27.364558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:27.364558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:27.364558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:27.364558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:27.364558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:27.364558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:27.364558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:27.364558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:27.364558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:27.364558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:38:27.364558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:38:27.364558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:38:27.364558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:38:27.366925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:38:27.366925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:38:27.366925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:38:27.366925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:38:27.366925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:27.366925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:27.366925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:27.366925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:27.366925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:27.366925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:27.366925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:27.366925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:27.366925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:27.366925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:27.366925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:27.366925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:27.369312 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:27.369312 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:27.369312 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:27.369312 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:27.369312 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:38:27.369312 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:38:27.369312 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:38:27.369312 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:38:27.369312 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:38:27.369312 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:38:27.369312 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:38:27.369312 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:38:27.373760 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 61/123] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 27 09:38:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:38:27.377611 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d56c9-ed27-472c-b89b-fa17a24199e3 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:27.432547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f52ae-e4a0-40d5-8ec7-bcb011e1f27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:27.433491 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f52ae-e4a0-40d5-8ec7-bcb011e1f27d None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:27.433901 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f52ae-e4a0-40d5-8ec7-bcb011e1f27d None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:27.434510 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f52ae-e4a0-40d5-8ec7-bcb011e1f27d None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:27.435840 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f52ae-e4a0-40d5-8ec7-bcb011e1f27d None admin] RBAC: Adding query filter params (name=member) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:27.436369 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f52ae-e4a0-40d5-8ec7-bcb011e1f27d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:27.439051 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f52ae-e4a0-40d5-8ec7-bcb011e1f27d None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:27.455482 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 63/124] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 27 09:38:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:27.456953 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f52ae-e4a0-40d5-8ec7-bcb011e1f27d None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:27.476523 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:27.524751 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d56c9-ed27-472c-b89b-fa17a24199e3 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:27.599183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f52ae-e4a0-40d5-8ec7-bcb011e1f27d None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:27.602206 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:27.610645 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50611380-6c2f-4eab-9db6-8833b5ad16fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:27.612087 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50611380-6c2f-4eab-9db6-8833b5ad16fa None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:27.613047 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50611380-6c2f-4eab-9db6-8833b5ad16fa None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:27.613708 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50611380-6c2f-4eab-9db6-8833b5ad16fa None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:27.615342 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50611380-6c2f-4eab-9db6-8833b5ad16fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:27.616077 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50611380-6c2f-4eab-9db6-8833b5ad16fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:27.619026 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50611380-6c2f-4eab-9db6-8833b5ad16fa None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:27.635278 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 62/125] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:38:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:27.637199 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50611380-6c2f-4eab-9db6-8833b5ad16fa None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:27.640213 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a03c7-b450-4f82-8f1f-e2cbfda0e375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:27.640924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a03c7-b450-4f82-8f1f-e2cbfda0e375 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:27.641212 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a03c7-b450-4f82-8f1f-e2cbfda0e375 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:27.641536 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a03c7-b450-4f82-8f1f-e2cbfda0e375 None admin] PATH_INFO: `/v3/projects/31d28ae3268846449a1741369164016a` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:27.642716 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a03c7-b450-4f82-8f1f-e2cbfda0e375 None admin] RBAC: Authorizing `identity:get_project(project_id=31d28ae3268846449a1741369164016a)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:27.644337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a03c7-b450-4f82-8f1f-e2cbfda0e375 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:27.650809 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 64/126] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:38:27 2022] GET /identity/v3/projects/31d28ae3268846449a1741369164016a => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:27.650809 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a03c7-b450-4f82-8f1f-e2cbfda0e375 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:27.761410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a03c7-b450-4f82-8f1f-e2cbfda0e375 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:27.829228 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50611380-6c2f-4eab-9db6-8833b5ad16fa None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:27.837391 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7653b-f806-44ee-962e-92402319042c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:27.838747 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7653b-f806-44ee-962e-92402319042c None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:27.839384 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7653b-f806-44ee-962e-92402319042c None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:27.839691 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7653b-f806-44ee-962e-92402319042c None admin] PATH_INFO: `/v3/users/2e0ed9493f0a42aca920506fd4534d15` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:27.842498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7653b-f806-44ee-962e-92402319042c None admin] RBAC: Authorizing `identity:get_user(user_id=2e0ed9493f0a42aca920506fd4534d15)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:27.845027 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7653b-f806-44ee-962e-92402319042c None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:27.848222 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 65/127] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:38:27 2022] GET /identity/v3/users/2e0ed9493f0a42aca920506fd4534d15 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:27.849998 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7653b-f806-44ee-962e-92402319042c None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:27.868927 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:27.879762 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0888dfd-0453-45fe-944c-775447c4d100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:27.880895 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0888dfd-0453-45fe-944c-775447c4d100 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:27.881424 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0888dfd-0453-45fe-944c-775447c4d100 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:27.881892 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0888dfd-0453-45fe-944c-775447c4d100 None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:27.882841 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0888dfd-0453-45fe-944c-775447c4d100 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:27.883358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0888dfd-0453-45fe-944c-775447c4d100 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:27.885008 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0888dfd-0453-45fe-944c-775447c4d100 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:27.895230 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 63/128] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:38:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:27.896929 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0888dfd-0453-45fe-944c-775447c4d100 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:27.940846 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:28.013540 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0888dfd-0453-45fe-944c-775447c4d100 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:28.054736 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe3086-abda-480d-a4b0-6590e0f1991d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:28.055785 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe3086-abda-480d-a4b0-6590e0f1991d None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:28.056281 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe3086-abda-480d-a4b0-6590e0f1991d None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:28.056756 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe3086-abda-480d-a4b0-6590e0f1991d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:28.057682 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe3086-abda-480d-a4b0-6590e0f1991d None admin] RBAC: Adding query filter params (role.id=2b7fd974b36e410db7b0003344b6a5f8, scope.project.id=31d28ae3268846449a1741369164016a, user.id=dca8acb99fe7491985b476b5c0d693fc) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:28.058204 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe3086-abda-480d-a4b0-6590e0f1991d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:28.059921 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe3086-abda-480d-a4b0-6590e0f1991d None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:28.060462 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7653b-f806-44ee-962e-92402319042c None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:28.067410 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 64/129] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:38:27 2022] GET /identity/v3/role_assignments?user.id=dca8acb99fe7491985b476b5c0d693fc&scope.project.id=31d28ae3268846449a1741369164016a&role.id=2b7fd974b36e410db7b0003344b6a5f8 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:28.068977 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe3086-abda-480d-a4b0-6590e0f1991d None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:28.155920 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7f2f0-2830-4afb-bab7-533471498d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:28.157003 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7f2f0-2830-4afb-bab7-533471498d03 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:28.157505 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7f2f0-2830-4afb-bab7-533471498d03 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:28.158380 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7f2f0-2830-4afb-bab7-533471498d03 None admin] PATH_INFO: `/v3/users/2e0ed9493f0a42aca920506fd4534d15` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:28.160645 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:28.166443 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7f2f0-2830-4afb-bab7-533471498d03 None admin] RBAC: Authorizing `identity:get_user(user_id=2e0ed9493f0a42aca920506fd4534d15)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:28.170282 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7f2f0-2830-4afb-bab7-533471498d03 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:28.179771 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 66/130] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:38:27 2022] GET /identity/v3/users/2e0ed9493f0a42aca920506fd4534d15 => generated 275 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:28.181322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7f2f0-2830-4afb-bab7-533471498d03 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:28.227155 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe3086-abda-480d-a4b0-6590e0f1991d None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:28.278096 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d773d9-f429-4d64-9932-24792fc20b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:28.279208 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d773d9-f429-4d64-9932-24792fc20b9c None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:28.279715 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d773d9-f429-4d64-9932-24792fc20b9c None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:28.280198 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d773d9-f429-4d64-9932-24792fc20b9c None admin] PATH_INFO: `/v3/projects/5b7777d2d99e4b62a0f549fa37ee4827` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:28.281718 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d773d9-f429-4d64-9932-24792fc20b9c None admin] RBAC: Authorizing `identity:get_project(project_id=5b7777d2d99e4b62a0f549fa37ee4827)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:28.283528 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d773d9-f429-4d64-9932-24792fc20b9c None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:28.291728 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 65/131] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:38:28 2022] GET /identity/v3/projects/5b7777d2d99e4b62a0f549fa37ee4827 => generated 312 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:28.293030 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d773d9-f429-4d64-9932-24792fc20b9c None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:28.393292 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7f2f0-2830-4afb-bab7-533471498d03 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:28.405734 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:28.443898 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb942503-4625-4d4e-8001-a50b7990f64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:28.445200 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb942503-4625-4d4e-8001-a50b7990f64b None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:28.445345 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb942503-4625-4d4e-8001-a50b7990f64b None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:28.445599 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb942503-4625-4d4e-8001-a50b7990f64b None admin] PATH_INFO: `/v3/users/e6a28914e72f4ed6b89baeb8d519808a` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:28.446872 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb942503-4625-4d4e-8001-a50b7990f64b None admin] RBAC: Authorizing `identity:get_user(user_id=e6a28914e72f4ed6b89baeb8d519808a)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:28.448418 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb942503-4625-4d4e-8001-a50b7990f64b None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:28.450349 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 67/132] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:38:28 2022] GET /identity/v3/users/e6a28914e72f4ed6b89baeb8d519808a => generated 247 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:28.451156 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb942503-4625-4d4e-8001-a50b7990f64b None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:28.520794 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d773d9-f429-4d64-9932-24792fc20b9c None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:28.566840 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:28.588309 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad6766-33ff-4220-bd22-d71a26da55f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:28.589354 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad6766-33ff-4220-bd22-d71a26da55f9 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:28.589842 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad6766-33ff-4220-bd22-d71a26da55f9 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:28.590311 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad6766-33ff-4220-bd22-d71a26da55f9 None admin] PATH_INFO: `/v3/projects/31d28ae3268846449a1741369164016a` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:28.591751 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad6766-33ff-4220-bd22-d71a26da55f9 None admin] RBAC: Authorizing `identity:get_project(project_id=31d28ae3268846449a1741369164016a)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:28.593502 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad6766-33ff-4220-bd22-d71a26da55f9 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:28.595834 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 66/133] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:38:28 2022] GET /identity/v3/projects/31d28ae3268846449a1741369164016a => generated 298 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:28.596885 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad6766-33ff-4220-bd22-d71a26da55f9 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:28.712053 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad6766-33ff-4220-bd22-d71a26da55f9 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:28.751871 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f3bcc-85af-4be6-915b-94d194edb8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:28.752915 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f3bcc-85af-4be6-915b-94d194edb8c2 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:28.753395 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f3bcc-85af-4be6-915b-94d194edb8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:28.753882 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f3bcc-85af-4be6-915b-94d194edb8c2 None admin] PATH_INFO: `/v3/projects/31d28ae3268846449a1741369164016a` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:28.755344 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f3bcc-85af-4be6-915b-94d194edb8c2 None admin] RBAC: Authorizing `identity:get_project(project_id=31d28ae3268846449a1741369164016a)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:28.757156 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f3bcc-85af-4be6-915b-94d194edb8c2 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:28.759750 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 67/134] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:38:28 2022] GET /identity/v3/projects/31d28ae3268846449a1741369164016a => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:28.760857 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f3bcc-85af-4be6-915b-94d194edb8c2 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:28.776236 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb942503-4625-4d4e-8001-a50b7990f64b None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:28.840245 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:28.894387 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a304a-7840-449b-9db9-822a3576f448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:28.895530 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a304a-7840-449b-9db9-822a3576f448 None admin] REQUEST_METHOD: `PUT` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:28.896006 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a304a-7840-449b-9db9-822a3576f448 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:28.896620 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f3bcc-85af-4be6-915b-94d194edb8c2 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:28.896727 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a304a-7840-449b-9db9-822a3576f448 None admin] PATH_INFO: `/v3/projects/5b7777d2d99e4b62a0f549fa37ee4827/users/2e0ed9493f0a42aca920506fd4534d15/roles/378cb7fb6a4e4e5e89ab9a0ecb09d86b` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:28.901892 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a304a-7840-449b-9db9-822a3576f448 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b7777d2d99e4b62a0f549fa37ee4827, user_id=2e0ed9493f0a42aca920506fd4534d15, role_id=378cb7fb6a4e4e5e89ab9a0ecb09d86b)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:28.904707 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a304a-7840-449b-9db9-822a3576f448 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:28.930468 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 68/135] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 27 09:38:28 2022] PUT /identity/v3/projects/5b7777d2d99e4b62a0f549fa37ee4827/users/2e0ed9493f0a42aca920506fd4534d15/roles/378cb7fb6a4e4e5e89ab9a0ecb09d86b => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 09:38:28.931650 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a304a-7840-449b-9db9-822a3576f448 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:28.969900 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e991dbf-53b6-4995-b3ad-64897d2762f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:28.972908 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e991dbf-53b6-4995-b3ad-64897d2762f6 None admin] REQUEST_METHOD: `PUT` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:28.973506 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e991dbf-53b6-4995-b3ad-64897d2762f6 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:28.973990 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e991dbf-53b6-4995-b3ad-64897d2762f6 None admin] PATH_INFO: `/v3/projects/31d28ae3268846449a1741369164016a/users/2e0ed9493f0a42aca920506fd4534d15/roles/3c0df08d0ed0435597a1d69ed45a49d4` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:28.980231 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e991dbf-53b6-4995-b3ad-64897d2762f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=31d28ae3268846449a1741369164016a, user_id=2e0ed9493f0a42aca920506fd4534d15, role_id=3c0df08d0ed0435597a1d69ed45a49d4)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:28.982418 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e991dbf-53b6-4995-b3ad-64897d2762f6 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:29.009134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 68/136] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 27 09:38:28 2022] PUT /identity/v3/projects/31d28ae3268846449a1741369164016a/users/2e0ed9493f0a42aca920506fd4534d15/roles/3c0df08d0ed0435597a1d69ed45a49d4 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 09:38:29.011309 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:29.011748 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fb240-87b4-41cb-a2bb-5cfc3b2680b3 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:29.012038 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fb240-87b4-41cb-a2bb-5cfc3b2680b3 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:29.012374 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fb240-87b4-41cb-a2bb-5cfc3b2680b3 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:29.014057 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 69/137] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:29.020333 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a15852-c68f-439f-8363-dce9f6de258c None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:29.020808 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a15852-c68f-439f-8363-dce9f6de258c None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:29.020950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a15852-c68f-439f-8363-dce9f6de258c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:29.059893 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-b2a15852-c68f-439f-8363-dce9f6de258c None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:29.061352 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-b2a15852-c68f-439f-8363-dce9f6de258c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:29.156632 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a304a-7840-449b-9db9-822a3576f448 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:29.227888 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f4274-3395-45fa-86cc-e8cd7a542e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:29.228605 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f4274-3395-45fa-86cc-e8cd7a542e6a None admin] REQUEST_METHOD: `PUT` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:29.228886 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f4274-3395-45fa-86cc-e8cd7a542e6a None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:29.229166 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f4274-3395-45fa-86cc-e8cd7a542e6a None admin] PATH_INFO: `/v3/projects/31d28ae3268846449a1741369164016a/users/e6a28914e72f4ed6b89baeb8d519808a/roles/7cc7d3c85c794033b590117321e97ccf` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:29.234818 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f4274-3395-45fa-86cc-e8cd7a542e6a None admin] RBAC: Authorizing `identity:create_grant(project_id=31d28ae3268846449a1741369164016a, user_id=e6a28914e72f4ed6b89baeb8d519808a, role_id=7cc7d3c85c794033b590117321e97ccf)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:29.236313 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f4274-3395-45fa-86cc-e8cd7a542e6a None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:29.268583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 69/138] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 27 09:38:28 2022] PUT /identity/v3/projects/31d28ae3268846449a1741369164016a/users/e6a28914e72f4ed6b89baeb8d519808a/roles/7cc7d3c85c794033b590117321e97ccf => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 09:38:29.278479 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 70/139] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:29.884117 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f4274-3395-45fa-86cc-e8cd7a542e6a None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:30.040238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:30.047460 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f4274-3395-45fa-86cc-e8cd7a542e6a None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:30.098164 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3dfb34-b7cc-4d69-9b53-dd7a3284be77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:30.099263 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3dfb34-b7cc-4d69-9b53-dd7a3284be77 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:30.100141 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3dfb34-b7cc-4d69-9b53-dd7a3284be77 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:30.100625 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3dfb34-b7cc-4d69-9b53-dd7a3284be77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:30.102151 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3dfb34-b7cc-4d69-9b53-dd7a3284be77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:30.103894 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3dfb34-b7cc-4d69-9b53-dd7a3284be77 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:30.106084 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 70/140] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:38:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:30.114556 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a15852-c68f-439f-8363-dce9f6de258c None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:30.251233 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:30.375852 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a15852-c68f-439f-8363-dce9f6de258c None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:30.460157 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a174562-93e0-4d44-969d-27977efda98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:30.461067 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a174562-93e0-4d44-969d-27977efda98d None admin] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:30.461482 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a174562-93e0-4d44-969d-27977efda98d None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:30.461954 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a174562-93e0-4d44-969d-27977efda98d None admin] PATH_INFO: `/v3/users` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:30.463124 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a174562-93e0-4d44-969d-27977efda98d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:30.465761 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a174562-93e0-4d44-969d-27977efda98d None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:30.552581 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 71/141] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 27 09:38:30 2022] POST /identity/v3/users => generated 283 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:38:32.296428 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227b843-ff52-4029-969e-4c59146577c8 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:32.297503 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227b843-ff52-4029-969e-4c59146577c8 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:32.297984 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227b843-ff52-4029-969e-4c59146577c8 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:32.299948 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 71/142] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:32.306582 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe12815-839d-4d06-a751-470c833714cf None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:32.307154 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe12815-839d-4d06-a751-470c833714cf None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:32.307581 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe12815-839d-4d06-a751-470c833714cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:32.320829 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738dded-e773-4e67-836d-ac30cfebd7a2 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:32.321467 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738dded-e773-4e67-836d-ac30cfebd7a2 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:32.321945 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738dded-e773-4e67-836d-ac30cfebd7a2 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:32.323773 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 72/143] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:38:32.350950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-5fe12815-839d-4d06-a751-470c833714cf None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:32.352981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-5fe12815-839d-4d06-a751-470c833714cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:32.367744 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb85987-8ae3-4a59-aa2f-5119db6bc4d2 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:32.368370 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb85987-8ae3-4a59-aa2f-5119db6bc4d2 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:32.368853 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb85987-8ae3-4a59-aa2f-5119db6bc4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:32.403852 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-5eb85987-8ae3-4a59-aa2f-5119db6bc4d2 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:32.405959 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-5eb85987-8ae3-4a59-aa2f-5119db6bc4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:32.530916 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 72/144] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:32.536318 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 73/145] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:32.833845 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dca34-9592-4005-9e97-e69c0c7c4cab None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:32.834634 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dca34-9592-4005-9e97-e69c0c7c4cab None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:32.835160 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dca34-9592-4005-9e97-e69c0c7c4cab None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:32.836886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 73/146] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:32.849967 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22672da-503a-436b-aced-773df9af235e None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:32.850626 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22672da-503a-436b-aced-773df9af235e None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:32.851204 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22672da-503a-436b-aced-773df9af235e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:32.876579 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-b22672da-503a-436b-aced-773df9af235e None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:32.878262 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-b22672da-503a-436b-aced-773df9af235e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:32.979060 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537dca34-9592-4005-9e97-e69c0c7c4cab None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:33.022552 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 74/147] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 09:38:33.067221 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:33.159111 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537dca34-9592-4005-9e97-e69c0c7c4cab None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:33.199413 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac41458-aac4-4175-83c8-5843dae1753b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:33.203672 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac41458-aac4-4175-83c8-5843dae1753b None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:33.203961 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac41458-aac4-4175-83c8-5843dae1753b None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:33.204243 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac41458-aac4-4175-83c8-5843dae1753b None admin] PATH_INFO: `/v3/roles/member` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:33.217395 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac41458-aac4-4175-83c8-5843dae1753b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:38:33.226901 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-6ac41458-aac4-4175-83c8-5843dae1753b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:38:33.226901 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:33.226901 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:33.226901 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:33.226901 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:33.226901 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:33.226901 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:33.226901 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:33.226901 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:33.226901 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:33.226901 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:33.226901 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:33.226901 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:38:33.226901 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:38:33.226901 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:38:33.226901 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:38:33.227817 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:38:33.227817 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:38:33.227817 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:38:33.227817 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:38:33.227817 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:33.227817 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:33.227817 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:33.227817 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:33.227817 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:33.227817 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:33.227817 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:33.227817 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:33.227817 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:33.227817 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:33.227817 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:33.227817 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:33.228569 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:33.228569 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:33.228569 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:33.228569 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:33.228569 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:38:33.228569 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:38:33.228569 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:38:33.228569 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:38:33.228569 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:38:33.228569 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:38:33.228569 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:38:33.228569 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:38:33.228569 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 74/148] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:38:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:38:33.237478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22672da-503a-436b-aced-773df9af235e None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:33.269239 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:33.372432 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22672da-503a-436b-aced-773df9af235e None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:33.419992 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec1d3c-7539-40ff-8c96-85ca4f934680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:33.420550 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec1d3c-7539-40ff-8c96-85ca4f934680 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:33.420829 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec1d3c-7539-40ff-8c96-85ca4f934680 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:33.421100 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec1d3c-7539-40ff-8c96-85ca4f934680 None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:33.421786 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec1d3c-7539-40ff-8c96-85ca4f934680 None admin] RBAC: Adding query filter params (name=member) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:33.422086 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec1d3c-7539-40ff-8c96-85ca4f934680 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:33.423534 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec1d3c-7539-40ff-8c96-85ca4f934680 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:33.436856 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 75/149] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 27 09:38:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:33.445591 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac41458-aac4-4175-83c8-5843dae1753b None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:33.553963 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec1d3c-7539-40ff-8c96-85ca4f934680 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:33.614884 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:33.618820 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac41458-aac4-4175-83c8-5843dae1753b None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:33.700315 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774b335-0515-4ffa-b6a6-dc784e9aefce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:33.700865 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774b335-0515-4ffa-b6a6-dc784e9aefce None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:33.701135 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774b335-0515-4ffa-b6a6-dc784e9aefce None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:33.701389 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774b335-0515-4ffa-b6a6-dc784e9aefce None admin] PATH_INFO: `/v3/users/2e0ed9493f0a42aca920506fd4534d15` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:33.703471 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774b335-0515-4ffa-b6a6-dc784e9aefce None admin] RBAC: Authorizing `identity:get_user(user_id=2e0ed9493f0a42aca920506fd4534d15)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:33.705919 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774b335-0515-4ffa-b6a6-dc784e9aefce None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:33.707668 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 75/150] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:38:33 2022] GET /identity/v3/users/2e0ed9493f0a42aca920506fd4534d15 => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:33.718500 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774b335-0515-4ffa-b6a6-dc784e9aefce None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:33.786033 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:33.819115 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec1d3c-7539-40ff-8c96-85ca4f934680 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:33.896321 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f38fa-1f27-4290-b9b8-e7d0797bc1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:33.897050 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f38fa-1f27-4290-b9b8-e7d0797bc1b1 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:33.897320 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f38fa-1f27-4290-b9b8-e7d0797bc1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:33.897588 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f38fa-1f27-4290-b9b8-e7d0797bc1b1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:33.924557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f38fa-1f27-4290-b9b8-e7d0797bc1b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:38:33.930172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-1f9f38fa-1f27-4290-b9b8-e7d0797bc1b1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 09:38:33.930172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:33.930172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:33.930172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:33.930172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:33.930172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:33.930172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:33.930172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:33.930172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:33.930172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:33.930172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:33.930172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:33.930172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:38:33.930172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:38:33.930172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:38:33.930172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:38:33.931862 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:38:33.931862 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:38:33.931862 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:38:33.931862 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:38:33.931862 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:33.931862 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:33.931862 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:33.931862 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:33.931862 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:33.931862 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:33.931862 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:33.931862 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:33.931862 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:33.931862 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:33.931862 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:33.931862 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:33.933337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:33.933337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:33.933337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:33.933337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:33.933337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:38:33.933337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:38:33.933337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:38:33.933337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:38:33.933337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:38:33.933337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:38:33.933337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 09:38:33.933337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:38:33.934472 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774b335-0515-4ffa-b6a6-dc784e9aefce None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:33.935739 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 76/151] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:38:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 09:38:33.938542 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab218bdf-a09a-4b84-8872-bf92a84e1643 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:33.939378 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab218bdf-a09a-4b84-8872-bf92a84e1643 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:33.940075 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab218bdf-a09a-4b84-8872-bf92a84e1643 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:33.942682 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 77/152] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:33.952452 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab218bdf-a09a-4b84-8872-bf92a84e1643 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:34.009142 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a755f0-8e06-4e76-a85f-8b99672b7e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:34.010266 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a755f0-8e06-4e76-a85f-8b99672b7e8c None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:34.010731 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a755f0-8e06-4e76-a85f-8b99672b7e8c None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:34.011230 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a755f0-8e06-4e76-a85f-8b99672b7e8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:34.069228 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:34.141969 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a755f0-8e06-4e76-a85f-8b99672b7e8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:34.144619 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a755f0-8e06-4e76-a85f-8b99672b7e8c None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:34.293359 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab218bdf-a09a-4b84-8872-bf92a84e1643 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:34.336108 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 76/153] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:38:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:38:34.342823 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfa6d0-77c2-4212-a4d7-293b535882e1 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:34.342823 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfa6d0-77c2-4212-a4d7-293b535882e1 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:34.342823 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfa6d0-77c2-4212-a4d7-293b535882e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:34.371436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-ffdfa6d0-77c2-4212-a4d7-293b535882e1 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:34.373503 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-ffdfa6d0-77c2-4212-a4d7-293b535882e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:34.414193 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0596ba-2964-466f-aaa3-fdab7c0e8e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:34.416050 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0596ba-2964-466f-aaa3-fdab7c0e8e64 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:34.416744 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0596ba-2964-466f-aaa3-fdab7c0e8e64 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:34.417360 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0596ba-2964-466f-aaa3-fdab7c0e8e64 None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:34.418806 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0596ba-2964-466f-aaa3-fdab7c0e8e64 None admin] RBAC: Adding query filter params (name=reader) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:34.419547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0596ba-2964-466f-aaa3-fdab7c0e8e64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:34.422347 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0596ba-2964-466f-aaa3-fdab7c0e8e64 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:34.439323 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 78/154] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 27 09:38:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 488 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:38:34.440339 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0596ba-2964-466f-aaa3-fdab7c0e8e64 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:34.461543 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:34.501862 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:34.509743 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 77/155] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:34.516071 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfa6d0-77c2-4212-a4d7-293b535882e1 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:34.753787 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0596ba-2964-466f-aaa3-fdab7c0e8e64 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:34.812946 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfa6d0-77c2-4212-a4d7-293b535882e1 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:34.853555 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2efb43-7cb6-497c-8ce7-7d2add9942ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:34.854160 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2efb43-7cb6-497c-8ce7-7d2add9942ac None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:34.854482 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2efb43-7cb6-497c-8ce7-7d2add9942ac None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:34.854695 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2efb43-7cb6-497c-8ce7-7d2add9942ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:34.888870 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2efb43-7cb6-497c-8ce7-7d2add9942ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:38:34.893941 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-df2efb43-7cb6-497c-8ce7-7d2add9942ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 09:38:34.893941 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:34.893941 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:34.893941 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:34.893941 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:34.893941 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:34.893941 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:34.893941 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:34.893941 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:34.893941 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:34.893941 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:34.893941 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:34.893941 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:38:34.893941 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:38:34.893941 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:38:34.893941 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:38:34.895084 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:38:34.895084 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:38:34.895084 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:38:34.895084 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:38:34.895084 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:34.895084 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:34.895084 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:34.895084 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:34.895084 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:34.895084 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:34.895084 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:34.895084 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:34.895084 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:34.895084 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:34.895084 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:34.895084 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:34.895955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:34.895955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:34.895955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:34.895955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:34.895955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:38:34.895955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:38:34.895955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:38:34.895955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:38:34.895955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:38:34.895955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:38:34.895955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 09:38:34.895955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:38:34.899312 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 79/156] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 27 09:38:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 459 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:38:34.900493 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2efb43-7cb6-497c-8ce7-7d2add9942ac None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:34.928462 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e113ef-7c29-421d-bae1-eec3b09baa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:34.929584 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e113ef-7c29-421d-bae1-eec3b09baa74 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:34.930234 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e113ef-7c29-421d-bae1-eec3b09baa74 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:34.930736 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e113ef-7c29-421d-bae1-eec3b09baa74 None admin] PATH_INFO: `/v3/projects/31d28ae3268846449a1741369164016a` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:34.936292 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e113ef-7c29-421d-bae1-eec3b09baa74 None admin] RBAC: Authorizing `identity:get_project(project_id=31d28ae3268846449a1741369164016a)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:34.939071 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e113ef-7c29-421d-bae1-eec3b09baa74 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:34.942921 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 78/157] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:38:34 2022] GET /identity/v3/projects/31d28ae3268846449a1741369164016a => generated 298 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:34.944919 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e113ef-7c29-421d-bae1-eec3b09baa74 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:35.052372 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:35.076994 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:35.147739 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2efb43-7cb6-497c-8ce7-7d2add9942ac None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:35.151992 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e113ef-7c29-421d-bae1-eec3b09baa74 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:35.224103 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32710c30-4afd-4d00-ad2d-cb1fbeb86fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:35.225318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32710c30-4afd-4d00-ad2d-cb1fbeb86fcb None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:35.225790 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32710c30-4afd-4d00-ad2d-cb1fbeb86fcb None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:35.226254 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32710c30-4afd-4d00-ad2d-cb1fbeb86fcb None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:35.227653 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32710c30-4afd-4d00-ad2d-cb1fbeb86fcb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:35.228376 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32710c30-4afd-4d00-ad2d-cb1fbeb86fcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:35.230881 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32710c30-4afd-4d00-ad2d-cb1fbeb86fcb None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:35.231554 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc042831-47b6-424a-b1a5-90b907b67a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:35.232220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc042831-47b6-424a-b1a5-90b907b67a5e None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:35.232493 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc042831-47b6-424a-b1a5-90b907b67a5e None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:35.232765 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc042831-47b6-424a-b1a5-90b907b67a5e None admin] PATH_INFO: `/v3/users/dca8acb99fe7491985b476b5c0d693fc` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:35.236361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc042831-47b6-424a-b1a5-90b907b67a5e None admin] RBAC: Authorizing `identity:get_user(user_id=dca8acb99fe7491985b476b5c0d693fc)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:35.236361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc042831-47b6-424a-b1a5-90b907b67a5e None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:35.238897 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 80/158] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:38:34 2022] GET /identity/v3/users/dca8acb99fe7491985b476b5c0d693fc => generated 289 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:35.239837 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc042831-47b6-424a-b1a5-90b907b67a5e None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:35.249675 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 79/159] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:38:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:35.254884 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43885bee-9cd9-4c4f-bcfc-d30b5bffb73b None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:35.256931 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43885bee-9cd9-4c4f-bcfc-d30b5bffb73b None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:35.257801 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43885bee-9cd9-4c4f-bcfc-d30b5bffb73b None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:35.265368 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 80/160] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:35 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:35.269006 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43885bee-9cd9-4c4f-bcfc-d30b5bffb73b None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:35.403204 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc042831-47b6-424a-b1a5-90b907b67a5e None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:35.441373 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4015cde-2322-4c76-a4a4-68578004dcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:35.442007 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4015cde-2322-4c76-a4a4-68578004dcfe None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:35.442281 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4015cde-2322-4c76-a4a4-68578004dcfe None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:35.442510 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4015cde-2322-4c76-a4a4-68578004dcfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:35.443437 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4015cde-2322-4c76-a4a4-68578004dcfe None admin] RBAC: Adding query filter params (role.id=378cb7fb6a4e4e5e89ab9a0ecb09d86b, scope.project.id=31d28ae3268846449a1741369164016a, user.id=2e0ed9493f0a42aca920506fd4534d15) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:35.443742 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4015cde-2322-4c76-a4a4-68578004dcfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:35.445348 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4015cde-2322-4c76-a4a4-68578004dcfe None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:35.448842 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:35.452898 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 81/161] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:38:35 2022] GET /identity/v3/role_assignments?user.id=2e0ed9493f0a42aca920506fd4534d15&scope.project.id=31d28ae3268846449a1741369164016a&role.id=378cb7fb6a4e4e5e89ab9a0ecb09d86b => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:35.454064 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4015cde-2322-4c76-a4a4-68578004dcfe None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:35.590183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4015cde-2322-4c76-a4a4-68578004dcfe None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:35.683942 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60481879-cc16-48e6-b6b7-1299423f7ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:35.684995 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60481879-cc16-48e6-b6b7-1299423f7ace None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:35.685496 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60481879-cc16-48e6-b6b7-1299423f7ace None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:35.686110 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60481879-cc16-48e6-b6b7-1299423f7ace None admin] PATH_INFO: `/v3/users/2e0ed9493f0a42aca920506fd4534d15` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:35.691887 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60481879-cc16-48e6-b6b7-1299423f7ace None admin] RBAC: Authorizing `identity:get_user(user_id=2e0ed9493f0a42aca920506fd4534d15)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:35.693905 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60481879-cc16-48e6-b6b7-1299423f7ace None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:35.696421 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 82/162] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:38:35 2022] GET /identity/v3/users/2e0ed9493f0a42aca920506fd4534d15 => generated 275 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:35.698346 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f660924-6ad9-4f8d-8748-27ba7058fabb None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:35.698977 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f660924-6ad9-4f8d-8748-27ba7058fabb None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:35.699456 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f660924-6ad9-4f8d-8748-27ba7058fabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:35.707877 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43885bee-9cd9-4c4f-bcfc-d30b5bffb73b None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:35.752639 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-4f660924-6ad9-4f8d-8748-27ba7058fabb None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:35.755421 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-4f660924-6ad9-4f8d-8748-27ba7058fabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:35.756774 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:35.778805 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de016d61-be8d-4224-b632-6e24e20cbeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:35.778805 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de016d61-be8d-4224-b632-6e24e20cbeef None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:35.778805 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de016d61-be8d-4224-b632-6e24e20cbeef None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:35.778805 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de016d61-be8d-4224-b632-6e24e20cbeef None admin] PATH_INFO: `/v3/projects/31d28ae3268846449a1741369164016a` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:35.779222 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de016d61-be8d-4224-b632-6e24e20cbeef None admin] RBAC: Authorizing `identity:get_project(project_id=31d28ae3268846449a1741369164016a)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:35.779485 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de016d61-be8d-4224-b632-6e24e20cbeef None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:35.781812 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 81/163] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:38:35 2022] GET /identity/v3/projects/31d28ae3268846449a1741369164016a => generated 298 bytes in 516 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:35.782661 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de016d61-be8d-4224-b632-6e24e20cbeef None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:35.927467 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de016d61-be8d-4224-b632-6e24e20cbeef None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:35.951313 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:35.952797 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 83/164] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:35.964477 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f660924-6ad9-4f8d-8748-27ba7058fabb None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:35.974255 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8180d38-4b9e-4a44-904e-e3312d7b71b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:35.975578 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8180d38-4b9e-4a44-904e-e3312d7b71b8 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:35.975578 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8180d38-4b9e-4a44-904e-e3312d7b71b8 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:35.975853 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8180d38-4b9e-4a44-904e-e3312d7b71b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:35.991855 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8180d38-4b9e-4a44-904e-e3312d7b71b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:38:35.997931 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-a8180d38-4b9e-4a44-904e-e3312d7b71b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:38:35.997931 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:35.997931 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:35.997931 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:35.997931 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:35.997931 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:35.997931 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:35.997931 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:35.997931 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:35.997931 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:35.997931 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:35.997931 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:35.997931 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:38:35.997931 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:38:35.997931 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:38:35.997931 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:38:35.999491 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:38:35.999491 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:38:35.999491 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:38:35.999491 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:38:35.999491 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:35.999491 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:35.999491 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:35.999491 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:35.999491 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:35.999491 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:35.999491 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:35.999491 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:35.999491 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:35.999491 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:35.999491 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:35.999491 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:36.000889 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:36.000889 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:36.000889 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:36.000889 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:36.000889 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:38:36.000889 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:38:36.000889 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:38:36.000889 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:38:36.000889 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:38:36.000889 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:38:36.000889 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:38:36.000889 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:38:36.000889 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 82/165] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 27 09:38:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:38:36.005114 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8180d38-4b9e-4a44-904e-e3312d7b71b8 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:36.072597 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:36.138185 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8180d38-4b9e-4a44-904e-e3312d7b71b8 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:36.183149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebb269-cea8-4d61-bee6-942e96dfd82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:36.184570 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebb269-cea8-4d61-bee6-942e96dfd82a None admin] REQUEST_METHOD: `PUT` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:36.184907 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebb269-cea8-4d61-bee6-942e96dfd82a None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:36.185247 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebb269-cea8-4d61-bee6-942e96dfd82a None admin] PATH_INFO: `/v3/projects/31d28ae3268846449a1741369164016a/users/dca8acb99fe7491985b476b5c0d693fc/roles/2b7fd974b36e410db7b0003344b6a5f8` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:36.192593 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ebb269-cea8-4d61-bee6-942e96dfd82a None admin] RBAC: Authorizing `identity:create_grant(project_id=31d28ae3268846449a1741369164016a, user_id=dca8acb99fe7491985b476b5c0d693fc, role_id=2b7fd974b36e410db7b0003344b6a5f8)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:36.194434 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ebb269-cea8-4d61-bee6-942e96dfd82a None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:36.223522 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f660924-6ad9-4f8d-8748-27ba7058fabb None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:36.227139 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 83/166] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 27 09:38:35 2022] PUT /identity/v3/projects/31d28ae3268846449a1741369164016a/users/dca8acb99fe7491985b476b5c0d693fc/roles/2b7fd974b36e410db7b0003344b6a5f8 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 09:38:36.228119 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebb269-cea8-4d61-bee6-942e96dfd82a None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:36.307748 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04d721-8702-4307-9352-61b9df8f6f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:36.308576 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04d721-8702-4307-9352-61b9df8f6f8e None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:36.308858 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04d721-8702-4307-9352-61b9df8f6f8e None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:36.309140 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04d721-8702-4307-9352-61b9df8f6f8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:36.377061 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebb269-cea8-4d61-bee6-942e96dfd82a None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:36.391911 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:36.423992 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269fba1c-13d7-41f2-8116-fe3c5967e1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:36.424791 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fba1c-13d7-41f2-8116-fe3c5967e1f8 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:36.425129 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fba1c-13d7-41f2-8116-fe3c5967e1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:36.425465 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fba1c-13d7-41f2-8116-fe3c5967e1f8 None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:36.426275 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269fba1c-13d7-41f2-8116-fe3c5967e1f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:36.426643 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269fba1c-13d7-41f2-8116-fe3c5967e1f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:36.428984 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269fba1c-13d7-41f2-8116-fe3c5967e1f8 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:36.440433 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 84/167] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:38:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:36.448030 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269fba1c-13d7-41f2-8116-fe3c5967e1f8 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:36.479939 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:36.492673 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04d721-8702-4307-9352-61b9df8f6f8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:36.494194 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04d721-8702-4307-9352-61b9df8f6f8e None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:36.587217 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269fba1c-13d7-41f2-8116-fe3c5967e1f8 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:36.651096 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b809ba-ad74-4bed-b256-11df66638bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:36.651759 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b809ba-ad74-4bed-b256-11df66638bbe None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:36.652030 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b809ba-ad74-4bed-b256-11df66638bbe None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:36.652296 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b809ba-ad74-4bed-b256-11df66638bbe None admin] PATH_INFO: `/v3/users/e6a28914e72f4ed6b89baeb8d519808a` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:36.654261 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b809ba-ad74-4bed-b256-11df66638bbe None admin] RBAC: Authorizing `identity:get_user(user_id=e6a28914e72f4ed6b89baeb8d519808a)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:36.656442 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b809ba-ad74-4bed-b256-11df66638bbe None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:36.658334 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 85/168] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:38:36 2022] GET /identity/v3/users/e6a28914e72f4ed6b89baeb8d519808a => generated 247 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:36.660847 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b809ba-ad74-4bed-b256-11df66638bbe None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:36.718599 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:36.775884 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 84/169] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:38:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 823 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:38:36.776797 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04d721-8702-4307-9352-61b9df8f6f8e None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:36.814138 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b809ba-ad74-4bed-b256-11df66638bbe None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:36.853439 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503be85-e32f-4629-80e8-9b4af3042682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:36.854095 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503be85-e32f-4629-80e8-9b4af3042682 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:36.854366 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503be85-e32f-4629-80e8-9b4af3042682 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:36.854628 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503be85-e32f-4629-80e8-9b4af3042682 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:36.869263 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503be85-e32f-4629-80e8-9b4af3042682 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:38:36.876066 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-3503be85-e32f-4629-80e8-9b4af3042682 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:38:36.876066 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:36.876066 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:36.876066 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:36.876066 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:36.876066 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:36.876066 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:36.876066 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:36.876066 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:36.876066 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:36.876066 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:36.876066 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:36.876066 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:38:36.876066 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:38:36.876066 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:38:36.876066 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:38:36.879345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:38:36.879345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:38:36.879345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:38:36.879345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:38:36.879345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:36.879345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:36.879345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:36.879345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:36.879345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:36.879345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:36.879345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:36.879345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:36.879345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:36.879345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:36.879345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:36.879345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:36.882354 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:36.882354 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:36.882354 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:36.882354 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:36.882354 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:38:36.882354 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:38:36.882354 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:38:36.882354 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:38:36.882354 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:38:36.882354 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:38:36.882354 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:38:36.882354 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:38:36.882354 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 86/170] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:38:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:38:36.882354 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503be85-e32f-4629-80e8-9b4af3042682 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:36.956017 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:36.962480 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04d721-8702-4307-9352-61b9df8f6f8e None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:37.003450 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebddc18-a96a-4692-99da-d84ae2191c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:37.004078 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebddc18-a96a-4692-99da-d84ae2191c04 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:37.004355 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebddc18-a96a-4692-99da-d84ae2191c04 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:37.004609 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebddc18-a96a-4692-99da-d84ae2191c04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:37.023377 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:37.027799 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503be85-e32f-4629-80e8-9b4af3042682 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:37.076620 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63090db-65d0-4559-a3ce-b04aa5f6abee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:37.077966 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63090db-65d0-4559-a3ce-b04aa5f6abee None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:37.078245 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63090db-65d0-4559-a3ce-b04aa5f6abee None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:37.078558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63090db-65d0-4559-a3ce-b04aa5f6abee None admin] PATH_INFO: `/v3/projects/31d28ae3268846449a1741369164016a` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:37.080471 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63090db-65d0-4559-a3ce-b04aa5f6abee None admin] RBAC: Authorizing `identity:get_project(project_id=31d28ae3268846449a1741369164016a)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:37.082558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63090db-65d0-4559-a3ce-b04aa5f6abee None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:37.085276 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 87/171] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:38:36 2022] GET /identity/v3/projects/31d28ae3268846449a1741369164016a => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:37.086356 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63090db-65d0-4559-a3ce-b04aa5f6abee None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:37.090956 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebddc18-a96a-4692-99da-d84ae2191c04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:37.092777 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebddc18-a96a-4692-99da-d84ae2191c04 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:37.204931 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:37.210448 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 85/172] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:38:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:38:37.211686 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb882271-626b-4fcb-bfd5-4ba0118a97ae None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:37.212081 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb882271-626b-4fcb-bfd5-4ba0118a97ae None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:37.212634 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb882271-626b-4fcb-bfd5-4ba0118a97ae None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:37.218886 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 86/173] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:37.219907 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb882271-626b-4fcb-bfd5-4ba0118a97ae None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:37.234877 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63090db-65d0-4559-a3ce-b04aa5f6abee None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:37.276791 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e18526-1388-451d-a728-f84d6ede3be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:37.277415 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e18526-1388-451d-a728-f84d6ede3be6 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:37.278037 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e18526-1388-451d-a728-f84d6ede3be6 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:37.278279 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e18526-1388-451d-a728-f84d6ede3be6 None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:37.279465 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e18526-1388-451d-a728-f84d6ede3be6 None admin] RBAC: Adding query filter params (name=member) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:37.279756 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e18526-1388-451d-a728-f84d6ede3be6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:37.281152 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e18526-1388-451d-a728-f84d6ede3be6 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:37.293114 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 88/174] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 27 09:38:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:37.294527 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecc7e3-7c67-473a-85c5-415a60f56c44 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:37.294823 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecc7e3-7c67-473a-85c5-415a60f56c44 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:37.295108 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecc7e3-7c67-473a-85c5-415a60f56c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:37.335800 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-9aecc7e3-7c67-473a-85c5-415a60f56c44 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:37.336937 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-9aecc7e3-7c67-473a-85c5-415a60f56c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:37.399615 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:37.416226 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb882271-626b-4fcb-bfd5-4ba0118a97ae None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:37.464554 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86e79b-5edb-4786-b065-c43e31995ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:37.465498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86e79b-5edb-4786-b065-c43e31995ab7 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:37.465773 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86e79b-5edb-4786-b065-c43e31995ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:37.466018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86e79b-5edb-4786-b065-c43e31995ab7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:37.466861 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86e79b-5edb-4786-b065-c43e31995ab7 None admin] RBAC: Adding query filter params (role.id=3c0df08d0ed0435597a1d69ed45a49d4, scope.project.id=31d28ae3268846449a1741369164016a, user.id=2e0ed9493f0a42aca920506fd4534d15) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:37.467171 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86e79b-5edb-4786-b065-c43e31995ab7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:37.469440 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86e79b-5edb-4786-b065-c43e31995ab7 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:37.477259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 87/175] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:38:37 2022] GET /identity/v3/role_assignments?user.id=2e0ed9493f0a42aca920506fd4534d15&scope.project.id=31d28ae3268846449a1741369164016a&role.id=3c0df08d0ed0435597a1d69ed45a49d4 => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:37.478824 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86e79b-5edb-4786-b065-c43e31995ab7 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:37.528655 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 89/176] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:37.529238 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecc7e3-7c67-473a-85c5-415a60f56c44 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:37.570838 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:37.617408 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86e79b-5edb-4786-b065-c43e31995ab7 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:37.663011 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94bfcd-bd6b-45f2-91e1-7e79de047a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:37.663689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94bfcd-bd6b-45f2-91e1-7e79de047a18 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:37.664064 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94bfcd-bd6b-45f2-91e1-7e79de047a18 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:37.664342 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94bfcd-bd6b-45f2-91e1-7e79de047a18 None admin] PATH_INFO: `/v3/projects/31d28ae3268846449a1741369164016a` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:37.667578 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f94bfcd-bd6b-45f2-91e1-7e79de047a18 None admin] RBAC: Authorizing `identity:get_project(project_id=31d28ae3268846449a1741369164016a)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:37.669097 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f94bfcd-bd6b-45f2-91e1-7e79de047a18 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:37.670905 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 88/177] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:38:37 2022] GET /identity/v3/projects/31d28ae3268846449a1741369164016a => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:37.680029 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94bfcd-bd6b-45f2-91e1-7e79de047a18 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:37.715041 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecc7e3-7c67-473a-85c5-415a60f56c44 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:37.767147 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7274c-7337-4352-858a-20ed23b67ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:37.768348 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7274c-7337-4352-858a-20ed23b67ef9 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:37.768726 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7274c-7337-4352-858a-20ed23b67ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:37.769216 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7274c-7337-4352-858a-20ed23b67ef9 None admin] PATH_INFO: `/v3/users/2e0ed9493f0a42aca920506fd4534d15` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:37.775076 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7274c-7337-4352-858a-20ed23b67ef9 None admin] RBAC: Authorizing `identity:get_user(user_id=2e0ed9493f0a42aca920506fd4534d15)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:37.777982 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7274c-7337-4352-858a-20ed23b67ef9 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:37.781048 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 90/178] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:38:37 2022] GET /identity/v3/users/2e0ed9493f0a42aca920506fd4534d15 => generated 275 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:37.789837 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7274c-7337-4352-858a-20ed23b67ef9 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:37.842106 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:37.946137 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7274c-7337-4352-858a-20ed23b67ef9 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:37.993209 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3e2bd-e452-4f84-950d-f744d9d4c429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:37.993856 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3e2bd-e452-4f84-950d-f744d9d4c429 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:37.994134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3e2bd-e452-4f84-950d-f744d9d4c429 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:37.994404 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3e2bd-e452-4f84-950d-f744d9d4c429 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:38.023339 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94bfcd-bd6b-45f2-91e1-7e79de047a18 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:38.102798 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f3e2bd-e452-4f84-950d-f744d9d4c429 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:38.104305 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f3e2bd-e452-4f84-950d-f744d9d4c429 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:38.130143 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:38.156393 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:38.176243 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90956b84-32b3-4d79-ae75-8d6892b0fe47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:38.179797 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90956b84-32b3-4d79-ae75-8d6892b0fe47 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:38.179797 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90956b84-32b3-4d79-ae75-8d6892b0fe47 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:38.179797 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90956b84-32b3-4d79-ae75-8d6892b0fe47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:38.179797 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90956b84-32b3-4d79-ae75-8d6892b0fe47 None admin] RBAC: Adding query filter params (role.id=7cc7d3c85c794033b590117321e97ccf, scope.project.id=31d28ae3268846449a1741369164016a, user.id=e6a28914e72f4ed6b89baeb8d519808a) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:38.180362 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90956b84-32b3-4d79-ae75-8d6892b0fe47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:38.184647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90956b84-32b3-4d79-ae75-8d6892b0fe47 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:38.211189 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 89/179] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:38:37 2022] GET /identity/v3/role_assignments?user.id=e6a28914e72f4ed6b89baeb8d519808a&scope.project.id=31d28ae3268846449a1741369164016a&role.id=7cc7d3c85c794033b590117321e97ccf => generated 608 bytes in 531 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:38:38.245575 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 91/180] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:38:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 27 09:38:38.252308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90956b84-32b3-4d79-ae75-8d6892b0fe47 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:38.321193 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b89f6c-ea98-4d69-bf32-1162afd7d437 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:38.321630 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b89f6c-ea98-4d69-bf32-1162afd7d437 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:38.321771 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b89f6c-ea98-4d69-bf32-1162afd7d437 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:38.323740 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 92/181] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:38:38.331342 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ee2d5-bef1-430f-b093-30bf51e95436 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:38.331612 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ee2d5-bef1-430f-b093-30bf51e95436 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:38.331938 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ee2d5-bef1-430f-b093-30bf51e95436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:38.360283 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-d15ee2d5-bef1-430f-b093-30bf51e95436 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:38.361428 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-d15ee2d5-bef1-430f-b093-30bf51e95436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:38.497382 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90956b84-32b3-4d79-ae75-8d6892b0fe47 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:38.502557 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 93/182] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 09:38:38.521482 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ee2d5-bef1-430f-b093-30bf51e95436 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:38.585981 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406a566-1a94-4313-80d7-f8b27d24dc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:38.586709 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406a566-1a94-4313-80d7-f8b27d24dc0e None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:38.587031 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406a566-1a94-4313-80d7-f8b27d24dc0e None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:38.587253 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406a566-1a94-4313-80d7-f8b27d24dc0e None admin] PATH_INFO: `/v3/projects/5b7777d2d99e4b62a0f549fa37ee4827` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:38.588960 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406a566-1a94-4313-80d7-f8b27d24dc0e None admin] RBAC: Authorizing `identity:get_project(project_id=5b7777d2d99e4b62a0f549fa37ee4827)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:38.594822 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406a566-1a94-4313-80d7-f8b27d24dc0e None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:38.594822 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 90/183] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:38:38 2022] GET /identity/v3/projects/5b7777d2d99e4b62a0f549fa37ee4827 => generated 312 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:38.601338 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406a566-1a94-4313-80d7-f8b27d24dc0e None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:38.686344 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:38.776977 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:38.796567 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ee2d5-bef1-430f-b093-30bf51e95436 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:38.846929 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406a566-1a94-4313-80d7-f8b27d24dc0e None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:38.870961 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092529d-6668-41ec-a2b2-c3ebaf8510dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:38.872546 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092529d-6668-41ec-a2b2-c3ebaf8510dc None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:38.873353 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092529d-6668-41ec-a2b2-c3ebaf8510dc None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:38.874083 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092529d-6668-41ec-a2b2-c3ebaf8510dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:38.895661 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6179c-a399-409f-956e-f43c973f04a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:38.896322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6179c-a399-409f-956e-f43c973f04a5 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:38.896666 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6179c-a399-409f-956e-f43c973f04a5 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:38.897000 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6179c-a399-409f-956e-f43c973f04a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:38.898847 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6179c-a399-409f-956e-f43c973f04a5 None admin] RBAC: Adding query filter params (role.id=378cb7fb6a4e4e5e89ab9a0ecb09d86b, scope.project.id=5b7777d2d99e4b62a0f549fa37ee4827, user.id=2e0ed9493f0a42aca920506fd4534d15) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:38.898847 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6179c-a399-409f-956e-f43c973f04a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:38.899648 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6179c-a399-409f-956e-f43c973f04a5 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:38.901024 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092529d-6668-41ec-a2b2-c3ebaf8510dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:38:38.906281 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 91/184] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:38:38 2022] GET /identity/v3/role_assignments?user.id=2e0ed9493f0a42aca920506fd4534d15&scope.project.id=5b7777d2d99e4b62a0f549fa37ee4827&role.id=378cb7fb6a4e4e5e89ab9a0ecb09d86b => generated 608 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:38:38.907690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccff1c-59d8-401a-8621-147f2e1e4c52 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:38.907973 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccff1c-59d8-401a-8621-147f2e1e4c52 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:38.908244 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccff1c-59d8-401a-8621-147f2e1e4c52 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:38.913537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-2092529d-6668-41ec-a2b2-c3ebaf8510dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 09:38:38.913537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:38.913537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:38.913537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:38.913537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:38.913537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:38.913537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:38.913537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:38.913537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:38.913537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:38.913537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:38.913537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:38.913537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:38:38.913537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:38:38.913537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:38:38.913537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:38:38.915255 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:38:38.915255 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:38:38.915255 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:38:38.915255 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:38:38.915255 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:38.915255 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:38.915255 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:38.915255 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:38.915255 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:38.915255 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:38.915255 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:38.915255 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:38.915255 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:38.915255 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:38.915255 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:38.915255 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:38.916782 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:38.916782 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:38.916782 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:38.916782 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:38.916782 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:38:38.916782 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:38:38.916782 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:38:38.916782 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:38:38.916782 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:38:38.916782 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:38:38.916782 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 09:38:38.916782 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:38:38.917912 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 92/185] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:38.917912 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e0439-1747-416c-a1f0-111e117e7b88 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:38.919131 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e0439-1747-416c-a1f0-111e117e7b88 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:38.919131 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e0439-1747-416c-a1f0-111e117e7b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:38.922320 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 94/186] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 27 09:38:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 09:38:38.933279 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092529d-6668-41ec-a2b2-c3ebaf8510dc None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:38.956097 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-c43e0439-1747-416c-a1f0-111e117e7b88 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:38.957329 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-c43e0439-1747-416c-a1f0-111e117e7b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:39.059262 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 93/187] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:39.061247 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e0439-1747-416c-a1f0-111e117e7b88 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:39.145132 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092529d-6668-41ec-a2b2-c3ebaf8510dc None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:39.186140 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:39.200209 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:39.242799 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5228970-212a-4da7-8187-9dae6e9d702d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:39.243332 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5228970-212a-4da7-8187-9dae6e9d702d None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:39.243609 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5228970-212a-4da7-8187-9dae6e9d702d None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:39.243880 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5228970-212a-4da7-8187-9dae6e9d702d None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:39.244570 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5228970-212a-4da7-8187-9dae6e9d702d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:39.244872 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5228970-212a-4da7-8187-9dae6e9d702d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:39.246334 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5228970-212a-4da7-8187-9dae6e9d702d None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:39.258940 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 95/188] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:38:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:38:39.269848 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5228970-212a-4da7-8187-9dae6e9d702d None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:39.292587 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e0439-1747-416c-a1f0-111e117e7b88 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:39.378365 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd113ed-dca0-4b3e-9aba-4121ec35cd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:39.379500 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd113ed-dca0-4b3e-9aba-4121ec35cd95 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:39.382797 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd113ed-dca0-4b3e-9aba-4121ec35cd95 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:39.382797 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd113ed-dca0-4b3e-9aba-4121ec35cd95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:39.409289 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd113ed-dca0-4b3e-9aba-4121ec35cd95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:38:39.424511 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-1dd113ed-dca0-4b3e-9aba-4121ec35cd95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:38:39.424511 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:39.424511 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:39.424511 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:39.424511 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:39.424511 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:39.424511 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:39.424511 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:39.424511 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:39.424511 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:39.424511 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:39.424511 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:39.424511 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:38:39.424511 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:38:39.424511 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:38:39.424511 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:38:39.425479 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:38:39.425479 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:38:39.425479 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:38:39.425479 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:38:39.425479 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:39.425479 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:39.425479 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:39.425479 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:39.425479 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:39.425479 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:39.425479 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:39.425479 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:39.425479 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:39.425479 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:39.425479 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:39.425479 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:39.426272 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:39.426272 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:39.426272 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:39.426272 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:39.426272 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:38:39.426272 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:38:39.426272 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:38:39.426272 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:38:39.426272 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:38:39.426272 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:38:39.426272 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:38:39.426272 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:38:39.427820 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 94/189] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 27 09:38:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:38:39.434050 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd113ed-dca0-4b3e-9aba-4121ec35cd95 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:39.448040 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5228970-212a-4da7-8187-9dae6e9d702d None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:39.516379 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b3ed9-098c-4dbb-8be9-cc21ea060af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:39.517304 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b3ed9-098c-4dbb-8be9-cc21ea060af9 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:39.517730 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b3ed9-098c-4dbb-8be9-cc21ea060af9 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:39.518129 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b3ed9-098c-4dbb-8be9-cc21ea060af9 None admin] PATH_INFO: `/v3/users/a377a147804e4fe197498ae5a76b7729` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:39.547387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b3ed9-098c-4dbb-8be9-cc21ea060af9 None admin] RBAC: Authorizing `identity:get_user(user_id=a377a147804e4fe197498ae5a76b7729)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:39.549396 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b3ed9-098c-4dbb-8be9-cc21ea060af9 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:39.559260 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 96/190] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:38:39 2022] GET /identity/v3/users/a377a147804e4fe197498ae5a76b7729 => generated 283 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:39.559260 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b3ed9-098c-4dbb-8be9-cc21ea060af9 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:39.626614 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd113ed-dca0-4b3e-9aba-4121ec35cd95 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:39.640312 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:39.676275 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:39.705492 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85c620-c1f3-461f-afeb-e3835f503fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:39.706245 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85c620-c1f3-461f-afeb-e3835f503fe7 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:39.706579 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85c620-c1f3-461f-afeb-e3835f503fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:39.706951 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85c620-c1f3-461f-afeb-e3835f503fe7 None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:39.708306 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85c620-c1f3-461f-afeb-e3835f503fe7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:39.708306 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85c620-c1f3-461f-afeb-e3835f503fe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:39.709659 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85c620-c1f3-461f-afeb-e3835f503fe7 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:39.721068 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 95/191] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:38:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:38:39.727957 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85c620-c1f3-461f-afeb-e3835f503fe7 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:39.765762 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b3ed9-098c-4dbb-8be9-cc21ea060af9 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:39.815282 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8d32b-e4c9-42db-9448-e918e15f67f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:39.816207 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8d32b-e4c9-42db-9448-e918e15f67f8 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:39.816207 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8d32b-e4c9-42db-9448-e918e15f67f8 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:39.816451 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8d32b-e4c9-42db-9448-e918e15f67f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:39.899228 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85c620-c1f3-461f-afeb-e3835f503fe7 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:39.902723 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8d32b-e4c9-42db-9448-e918e15f67f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:39.904543 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8d32b-e4c9-42db-9448-e918e15f67f8 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:39.958232 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:39.966911 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2b81e-e8f1-4784-994d-0407b1b55eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:39.968384 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2b81e-e8f1-4784-994d-0407b1b55eb1 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:39.968861 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2b81e-e8f1-4784-994d-0407b1b55eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:39.969323 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2b81e-e8f1-4784-994d-0407b1b55eb1 None admin] PATH_INFO: `/v3/users/a377a147804e4fe197498ae5a76b7729` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:39.971480 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2b81e-e8f1-4784-994d-0407b1b55eb1 None admin] RBAC: Authorizing `identity:get_user(user_id=a377a147804e4fe197498ae5a76b7729)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:39.974080 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2b81e-e8f1-4784-994d-0407b1b55eb1 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:39.982368 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 96/192] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:38:39 2022] GET /identity/v3/users/a377a147804e4fe197498ae5a76b7729 => generated 283 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:38:39.982368 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2b81e-e8f1-4784-994d-0407b1b55eb1 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:40.045065 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 97/193] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:38:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:38:40.049234 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8d32b-e4c9-42db-9448-e918e15f67f8 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:40.066421 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:40.153310 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2b81e-e8f1-4784-994d-0407b1b55eb1 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:40.199419 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c8b90-caf8-4dec-bb23-961df7ae6848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:40.200249 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c8b90-caf8-4dec-bb23-961df7ae6848 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:40.200660 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c8b90-caf8-4dec-bb23-961df7ae6848 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:40.201047 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c8b90-caf8-4dec-bb23-961df7ae6848 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:40.202503 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c8b90-caf8-4dec-bb23-961df7ae6848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:40.204410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c8b90-caf8-4dec-bb23-961df7ae6848 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:40.211003 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 97/194] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:38:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:40.211003 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c8b90-caf8-4dec-bb23-961df7ae6848 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:40.227065 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8d32b-e4c9-42db-9448-e918e15f67f8 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:40.278205 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52007cdc-21af-44b3-a9f2-09e16b17f1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:40.279058 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52007cdc-21af-44b3-a9f2-09e16b17f1f3 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:40.279451 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52007cdc-21af-44b3-a9f2-09e16b17f1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:40.279881 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52007cdc-21af-44b3-a9f2-09e16b17f1f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:40.292905 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:40.389902 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c8b90-caf8-4dec-bb23-961df7ae6848 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:40.401081 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52007cdc-21af-44b3-a9f2-09e16b17f1f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:40.402880 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52007cdc-21af-44b3-a9f2-09e16b17f1f3 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:40.420109 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:40.451179 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd36364-ca65-41c3-afbd-e3fe2efe5193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:40.452141 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd36364-ca65-41c3-afbd-e3fe2efe5193 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:40.452141 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd36364-ca65-41c3-afbd-e3fe2efe5193 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:40.452449 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd36364-ca65-41c3-afbd-e3fe2efe5193 None admin] PATH_INFO: `/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:40.453707 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd36364-ca65-41c3-afbd-e3fe2efe5193 None admin] RBAC: Authorizing `identity:get_project(project_id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:40.455243 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd36364-ca65-41c3-afbd-e3fe2efe5193 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:40.465360 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 98/195] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:38:40 2022] GET /identity/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:40.465360 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd36364-ca65-41c3-afbd-e3fe2efe5193 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:40.604979 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 98/196] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:38:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:38:40.613163 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52007cdc-21af-44b3-a9f2-09e16b17f1f3 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:40.646721 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd36364-ca65-41c3-afbd-e3fe2efe5193 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:40.677373 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:40.711999 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ccf4b-9a29-4e31-baa0-b2df430d3fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:40.713157 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ccf4b-9a29-4e31-baa0-b2df430d3fb8 None admin] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:40.713645 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ccf4b-9a29-4e31-baa0-b2df430d3fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:40.714121 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ccf4b-9a29-4e31-baa0-b2df430d3fb8 None admin] PATH_INFO: `/v3/users` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:40.715384 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ccf4b-9a29-4e31-baa0-b2df430d3fb8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:40.718122 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ccf4b-9a29-4e31-baa0-b2df430d3fb8 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:40.756851 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52007cdc-21af-44b3-a9f2-09e16b17f1f3 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:40.757389 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 99/197] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 27 09:38:40 2022] POST /identity/v3/users => generated 297 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:38:40.767126 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ccf4b-9a29-4e31-baa0-b2df430d3fb8 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:40.846097 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626f9a1-0693-4f1e-9d92-47f94d273070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:40.847198 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626f9a1-0693-4f1e-9d92-47f94d273070 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:40.847626 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626f9a1-0693-4f1e-9d92-47f94d273070 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:40.848124 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626f9a1-0693-4f1e-9d92-47f94d273070 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:40.849669 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626f9a1-0693-4f1e-9d92-47f94d273070 None admin] RBAC: Adding query filter params (role.id=3c0df08d0ed0435597a1d69ed45a49d4, scope.project.id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d, user.id=a377a147804e4fe197498ae5a76b7729) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:40.850221 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626f9a1-0693-4f1e-9d92-47f94d273070 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:40.854185 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626f9a1-0693-4f1e-9d92-47f94d273070 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:40.867168 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:40.872195 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 99/198] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:38:40 2022] GET /identity/v3/role_assignments?user.id=a377a147804e4fe197498ae5a76b7729&scope.project.id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d&role.id=3c0df08d0ed0435597a1d69ed45a49d4 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:40.892469 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e804d0a-2873-44b2-9611-adb7bdda2bf0 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:40.892975 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e804d0a-2873-44b2-9611-adb7bdda2bf0 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:40.893432 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e804d0a-2873-44b2-9611-adb7bdda2bf0 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:40.897270 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 100/199] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:38:40.909069 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb0749-c37a-41e7-a942-9d17619ec381 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:40.909781 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb0749-c37a-41e7-a942-9d17619ec381 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:40.910742 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb0749-c37a-41e7-a942-9d17619ec381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:40.948215 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-26cb0749-c37a-41e7-a942-9d17619ec381 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:40.950402 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-26cb0749-c37a-41e7-a942-9d17619ec381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:40.967464 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ccf4b-9a29-4e31-baa0-b2df430d3fb8 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:41.012011 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75cca5-8fdd-4583-aba4-b5968fe558b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:41.012916 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75cca5-8fdd-4583-aba4-b5968fe558b4 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:41.013348 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75cca5-8fdd-4583-aba4-b5968fe558b4 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:41.013729 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75cca5-8fdd-4583-aba4-b5968fe558b4 None admin] PATH_INFO: `/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:41.015662 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75cca5-8fdd-4583-aba4-b5968fe558b4 None admin] RBAC: Authorizing `identity:get_project(project_id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:41.017178 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75cca5-8fdd-4583-aba4-b5968fe558b4 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:41.019776 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 100/200] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:38:40 2022] GET /identity/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:41.026638 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75cca5-8fdd-4583-aba4-b5968fe558b4 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:41.099477 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 101/201] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:41.185228 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75cca5-8fdd-4583-aba4-b5968fe558b4 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:41.194540 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:41.235482 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574ca53-e931-44d2-b961-563ddff3c583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:41.236133 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574ca53-e931-44d2-b961-563ddff3c583 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:41.236414 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574ca53-e931-44d2-b961-563ddff3c583 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:41.236692 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574ca53-e931-44d2-b961-563ddff3c583 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:41.237528 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574ca53-e931-44d2-b961-563ddff3c583 None admin] RBAC: Adding query filter params (role.id=7cc7d3c85c794033b590117321e97ccf, scope.project.id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d, user.id=a377a147804e4fe197498ae5a76b7729) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:41.237845 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574ca53-e931-44d2-b961-563ddff3c583 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:41.239404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574ca53-e931-44d2-b961-563ddff3c583 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:41.247308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 101/202] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:38:41 2022] GET /identity/v3/role_assignments?user.id=a377a147804e4fe197498ae5a76b7729&scope.project.id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d&role.id=7cc7d3c85c794033b590117321e97ccf => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:38:41.776391 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb0749-c37a-41e7-a942-9d17619ec381 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:41.820509 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:41.997663 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb0749-c37a-41e7-a942-9d17619ec381 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:42.086508 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031fe6e-3065-43d5-a635-901ca10d3c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:42.087733 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031fe6e-3065-43d5-a635-901ca10d3c10 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:42.088196 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031fe6e-3065-43d5-a635-901ca10d3c10 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:42.088654 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031fe6e-3065-43d5-a635-901ca10d3c10 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:42.114652 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031fe6e-3065-43d5-a635-901ca10d3c10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:38:42.125150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-d031fe6e-3065-43d5-a635-901ca10d3c10 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 09:38:42.125150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:42.125150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:42.125150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:42.125150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:42.125150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:42.125150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:42.125150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:42.125150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:42.125150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:42.125150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:42.125150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:42.125150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:38:42.125150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:38:42.125150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:38:42.125150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:38:42.126871 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:38:42.126871 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:38:42.126871 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:38:42.126871 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:38:42.126871 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:42.126871 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:42.126871 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:42.126871 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:42.126871 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:42.126871 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:42.126871 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:42.126871 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:42.126871 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:42.126871 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:42.126871 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:42.126871 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:42.128410 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:42.128410 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:42.128410 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:42.128410 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:42.128410 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:38:42.128410 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:38:42.128410 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:38:42.128410 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:38:42.128410 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:38:42.128410 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:38:42.128410 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 09:38:42.128410 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:38:42.138903 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 102/203] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:38:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:38:42.143933 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574ca53-e931-44d2-b961-563ddff3c583 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:42.339259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574ca53-e931-44d2-b961-563ddff3c583 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:42.396927 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a5d80-e2ad-4a30-8cf8-583d6a02b316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:42.397604 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a5d80-e2ad-4a30-8cf8-583d6a02b316 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:42.397952 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a5d80-e2ad-4a30-8cf8-583d6a02b316 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:42.398221 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a5d80-e2ad-4a30-8cf8-583d6a02b316 None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:42.398934 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a5d80-e2ad-4a30-8cf8-583d6a02b316 None admin] RBAC: Adding query filter params (name=reader) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:42.399233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a5d80-e2ad-4a30-8cf8-583d6a02b316 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:42.400649 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a5d80-e2ad-4a30-8cf8-583d6a02b316 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:42.415817 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 102/204] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 27 09:38:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:42.425197 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031fe6e-3065-43d5-a635-901ca10d3c10 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:42.634851 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:42.654585 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031fe6e-3065-43d5-a635-901ca10d3c10 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:42.745447 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27755eaa-d17c-42bd-bfb0-818aedc5c848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:42.746519 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27755eaa-d17c-42bd-bfb0-818aedc5c848 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:42.746925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27755eaa-d17c-42bd-bfb0-818aedc5c848 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:42.747322 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27755eaa-d17c-42bd-bfb0-818aedc5c848 None admin] PATH_INFO: `/v3/users/dca8acb99fe7491985b476b5c0d693fc` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:42.749396 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27755eaa-d17c-42bd-bfb0-818aedc5c848 None admin] RBAC: Authorizing `identity:get_user(user_id=dca8acb99fe7491985b476b5c0d693fc)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:42.751960 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27755eaa-d17c-42bd-bfb0-818aedc5c848 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:42.757655 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 103/205] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:38:42 2022] GET /identity/v3/users/dca8acb99fe7491985b476b5c0d693fc => generated 289 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:42.766567 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a5d80-e2ad-4a30-8cf8-583d6a02b316 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:42.832069 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:42.953195 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a5d80-e2ad-4a30-8cf8-583d6a02b316 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:43.007157 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a57eb2-47f2-433e-a656-58aa6bf0f2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:43.007799 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a57eb2-47f2-433e-a656-58aa6bf0f2f5 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:43.008073 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a57eb2-47f2-433e-a656-58aa6bf0f2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:43.008346 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a57eb2-47f2-433e-a656-58aa6bf0f2f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:43.110226 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a57eb2-47f2-433e-a656-58aa6bf0f2f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:43.111784 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a57eb2-47f2-433e-a656-58aa6bf0f2f5 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:43.157441 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:43.267100 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 103/206] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:38:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:38:43.277370 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27755eaa-d17c-42bd-bfb0-818aedc5c848 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:43.543659 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27755eaa-d17c-42bd-bfb0-818aedc5c848 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:43.618449 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8adc9a-9c1e-4ac5-8f31-a68bfeeaccb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:43.619575 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8adc9a-9c1e-4ac5-8f31-a68bfeeaccb2 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:43.620065 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8adc9a-9c1e-4ac5-8f31-a68bfeeaccb2 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:43.620552 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8adc9a-9c1e-4ac5-8f31-a68bfeeaccb2 None admin] PATH_INFO: `/v3/projects/31d28ae3268846449a1741369164016a` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:43.622650 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8adc9a-9c1e-4ac5-8f31-a68bfeeaccb2 None admin] RBAC: Authorizing `identity:get_project(project_id=31d28ae3268846449a1741369164016a)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:43.624971 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8adc9a-9c1e-4ac5-8f31-a68bfeeaccb2 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:43.627902 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 104/207] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:38:43 2022] GET /identity/v3/projects/31d28ae3268846449a1741369164016a => generated 298 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:43.637926 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a57eb2-47f2-433e-a656-58aa6bf0f2f5 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:43.855643 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a57eb2-47f2-433e-a656-58aa6bf0f2f5 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:43.907714 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:43.918582 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec497e45-3340-4ad4-a3b2-a8907080853c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:43.919238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec497e45-3340-4ad4-a3b2-a8907080853c None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:43.919512 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec497e45-3340-4ad4-a3b2-a8907080853c None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:43.919782 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec497e45-3340-4ad4-a3b2-a8907080853c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:43.920530 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec497e45-3340-4ad4-a3b2-a8907080853c None admin] RBAC: Adding query filter params (role.id=2b7fd974b36e410db7b0003344b6a5f8, scope.project.id=31d28ae3268846449a1741369164016a, user.id=dca8acb99fe7491985b476b5c0d693fc) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:43.920840 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec497e45-3340-4ad4-a3b2-a8907080853c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:43.922398 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec497e45-3340-4ad4-a3b2-a8907080853c None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:43.932746 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 104/208] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:38:43 2022] GET /identity/v3/role_assignments?user.id=dca8acb99fe7491985b476b5c0d693fc&scope.project.id=31d28ae3268846449a1741369164016a&role.id=2b7fd974b36e410db7b0003344b6a5f8 => generated 608 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:38:44.478548 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ecf72-06b9-4709-bbde-cc0e52cb765b None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:44.479141 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ecf72-06b9-4709-bbde-cc0e52cb765b None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:44.479141 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ecf72-06b9-4709-bbde-cc0e52cb765b None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:44.480535 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 105/209] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:44.486604 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d041009-4bb4-474d-b5d2-e6b8854289f8 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:44.487158 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d041009-4bb4-474d-b5d2-e6b8854289f8 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:44.487386 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d041009-4bb4-474d-b5d2-e6b8854289f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:44.519447 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-7d041009-4bb4-474d-b5d2-e6b8854289f8 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:44.522229 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-7d041009-4bb4-474d-b5d2-e6b8854289f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:44.653542 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 105/210] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:44.728376 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3772e-cae7-4756-bf76-b38b13d0cc1d None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:44.728788 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3772e-cae7-4756-bf76-b38b13d0cc1d None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:44.728950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3772e-cae7-4756-bf76-b38b13d0cc1d None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:44.730301 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 106/211] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:44.736954 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbff80-26bc-4bb3-867d-8ca8519e5178 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:44.737433 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbff80-26bc-4bb3-867d-8ca8519e5178 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:44.737797 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbff80-26bc-4bb3-867d-8ca8519e5178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:44.773169 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-01dbff80-26bc-4bb3-867d-8ca8519e5178 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:44.775297 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-01dbff80-26bc-4bb3-867d-8ca8519e5178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:44.928839 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 106/212] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:45.144313 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31016eec-b777-42c5-bdb8-1e7831d88633 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:45.145384 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31016eec-b777-42c5-bdb8-1e7831d88633 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:45.146141 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31016eec-b777-42c5-bdb8-1e7831d88633 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:45.149009 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 107/213] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:45.158099 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beaca9c-a5d8-4752-b7b9-76309c368744 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:45.158507 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beaca9c-a5d8-4752-b7b9-76309c368744 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:45.158690 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beaca9c-a5d8-4752-b7b9-76309c368744 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:45.159952 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd14690-4029-455b-afd1-b82b463c9694 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:45.160113 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 108/214] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:38:45.161583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd14690-4029-455b-afd1-b82b463c9694 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:45.162513 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd14690-4029-455b-afd1-b82b463c9694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:45.166530 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a8c09-24c4-48c8-a420-8d09bb37da37 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:45.166949 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a8c09-24c4-48c8-a420-8d09bb37da37 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:45.167094 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a8c09-24c4-48c8-a420-8d09bb37da37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:45.187923 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-c16a8c09-24c4-48c8-a420-8d09bb37da37 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:45.189270 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-c16a8c09-24c4-48c8-a420-8d09bb37da37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:45.197342 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-2dd14690-4029-455b-afd1-b82b463c9694 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:45.200413 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-2dd14690-4029-455b-afd1-b82b463c9694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:45.227655 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:45.286533 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:45.302134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 109/215] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 09:38:45.303698 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a8c09-24c4-48c8-a420-8d09bb37da37 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:45.309584 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 107/216] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:45.318571 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd14690-4029-455b-afd1-b82b463c9694 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:45.540202 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a8c09-24c4-48c8-a420-8d09bb37da37 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:45.551392 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd14690-4029-455b-afd1-b82b463c9694 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:45.629742 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f3a11-429c-4094-aa12-2669453afd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:45.631279 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f3a11-429c-4094-aa12-2669453afd13 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:45.631764 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f3a11-429c-4094-aa12-2669453afd13 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:45.632226 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f3a11-429c-4094-aa12-2669453afd13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:45.643442 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e4600-6b24-48e9-9b1b-708618c21331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:45.644525 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e4600-6b24-48e9-9b1b-708618c21331 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:45.645003 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e4600-6b24-48e9-9b1b-708618c21331 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:45.645463 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e4600-6b24-48e9-9b1b-708618c21331 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:45.655342 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f3a11-429c-4094-aa12-2669453afd13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:38:45.664714 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e4600-6b24-48e9-9b1b-708618c21331 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:38:45.666455 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-1c9f3a11-429c-4094-aa12-2669453afd13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:38:45.666455 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:45.666455 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:45.666455 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:45.666455 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:45.666455 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:45.666455 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:45.666455 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:45.666455 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:45.666455 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:45.666455 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:45.666455 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:45.666455 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:38:45.666455 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:38:45.666455 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:38:45.666455 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:38:45.667528 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:38:45.667528 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:38:45.667528 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:38:45.667528 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:38:45.667528 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:45.667528 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:45.667528 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:45.667528 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:45.667528 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:45.667528 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:45.667528 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:45.667528 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:45.667528 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:45.667528 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:45.667528 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:45.667528 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:45.668371 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:45.668371 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:45.668371 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:45.668371 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:45.668371 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:38:45.668371 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:38:45.668371 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:38:45.668371 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:38:45.668371 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:38:45.668371 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:38:45.668371 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:38:45.668371 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:38:45.669286 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 110/217] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 27 09:38:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:38:45.670314 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f3a11-429c-4094-aa12-2669453afd13 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:45.674238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-729e4600-6b24-48e9-9b1b-708618c21331 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 09:38:45.674238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:45.674238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:45.674238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:45.674238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:45.674238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:45.674238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:45.674238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:45.674238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:45.674238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:45.674238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:45.674238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:45.674238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:38:45.674238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:38:45.674238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:38:45.674238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:38:45.675251 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:38:45.675251 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:38:45.675251 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:38:45.675251 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:38:45.675251 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:45.675251 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:45.675251 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:45.675251 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:45.675251 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:45.675251 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:45.675251 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:45.675251 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:45.675251 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:45.675251 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:45.675251 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:45.675251 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:45.676005 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:45.676005 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:45.676005 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:45.676005 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:45.676005 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:38:45.676005 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:38:45.676005 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:38:45.676005 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:38:45.676005 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:38:45.676005 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:38:45.676005 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 09:38:45.676005 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:38:45.677542 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 108/218] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 27 09:38:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:38:45.680311 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e4600-6b24-48e9-9b1b-708618c21331 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:45.692914 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:45.750589 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:45.797424 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f3a11-429c-4094-aa12-2669453afd13 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:45.819455 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e4600-6b24-48e9-9b1b-708618c21331 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:45.846547 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9c5dd-4c2c-402a-a25f-6eb6fb7ba498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:45.847228 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9c5dd-4c2c-402a-a25f-6eb6fb7ba498 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:45.847502 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9c5dd-4c2c-402a-a25f-6eb6fb7ba498 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:45.847767 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9c5dd-4c2c-402a-a25f-6eb6fb7ba498 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:45.859954 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9c5dd-4c2c-402a-a25f-6eb6fb7ba498 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:38:45.861064 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eff288-42f6-4ca2-be10-4dbab2b14d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:45.861713 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eff288-42f6-4ca2-be10-4dbab2b14d0c None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:45.861986 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eff288-42f6-4ca2-be10-4dbab2b14d0c None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:45.862251 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eff288-42f6-4ca2-be10-4dbab2b14d0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:45.863449 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eff288-42f6-4ca2-be10-4dbab2b14d0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:45.864921 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eff288-42f6-4ca2-be10-4dbab2b14d0c None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:45.865054 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-17a9c5dd-4c2c-402a-a25f-6eb6fb7ba498 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:38:45.865054 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:45.865054 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:45.865054 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:45.865054 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:45.865054 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:45.865054 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:45.865054 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:45.865054 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:45.865054 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:45.865054 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:45.865054 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:45.865054 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:38:45.865054 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:38:45.865054 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:38:45.865054 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:38:45.867358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:38:45.867358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:38:45.867358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:38:45.867358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:38:45.867358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:45.867358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:45.867358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:45.867358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:45.867358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:45.867358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:45.867358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:45.867358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:45.867358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:45.867358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:45.867358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:45.867358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:45.868837 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:45.868837 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:45.868837 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:45.868837 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:45.868837 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:38:45.868837 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:38:45.868837 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:38:45.868837 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:38:45.868837 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:38:45.868837 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:38:45.868837 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:38:45.868837 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:38:45.868837 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 111/219] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:38:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:38:45.868837 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9c5dd-4c2c-402a-a25f-6eb6fb7ba498 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:45.870238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 109/220] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:38:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:45.870238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eff288-42f6-4ca2-be10-4dbab2b14d0c None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:45.987342 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:46.008259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eff288-42f6-4ca2-be10-4dbab2b14d0c None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:46.025256 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:46.028530 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9c5dd-4c2c-402a-a25f-6eb6fb7ba498 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:46.048384 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d0aed-cd65-4d2c-a25a-ad3b01ce38aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:46.048921 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d0aed-cd65-4d2c-a25a-ad3b01ce38aa None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:46.049203 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d0aed-cd65-4d2c-a25a-ad3b01ce38aa None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:46.049463 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d0aed-cd65-4d2c-a25a-ad3b01ce38aa None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:46.050136 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d0aed-cd65-4d2c-a25a-ad3b01ce38aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:46.050433 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d0aed-cd65-4d2c-a25a-ad3b01ce38aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:46.051883 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d0aed-cd65-4d2c-a25a-ad3b01ce38aa None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:46.063874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 110/221] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:38:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:46.065329 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d0aed-cd65-4d2c-a25a-ad3b01ce38aa None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:46.084849 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e280c8-8bf1-4cab-b85e-a234c8dd8931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:46.085513 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e280c8-8bf1-4cab-b85e-a234c8dd8931 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:46.085955 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e280c8-8bf1-4cab-b85e-a234c8dd8931 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:46.086275 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e280c8-8bf1-4cab-b85e-a234c8dd8931 None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:46.087419 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e280c8-8bf1-4cab-b85e-a234c8dd8931 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:46.087916 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e280c8-8bf1-4cab-b85e-a234c8dd8931 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:46.090320 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e280c8-8bf1-4cab-b85e-a234c8dd8931 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:46.107810 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 112/222] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:38:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:46.107810 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e280c8-8bf1-4cab-b85e-a234c8dd8931 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:46.195834 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d0aed-cd65-4d2c-a25a-ad3b01ce38aa None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:46.234745 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10b642-2983-4534-b477-1757bfb220a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:46.235691 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10b642-2983-4534-b477-1757bfb220a3 None admin] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:46.236068 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10b642-2983-4534-b477-1757bfb220a3 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:46.236458 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10b642-2983-4534-b477-1757bfb220a3 None admin] PATH_INFO: `/v3/users` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:46.237242 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10b642-2983-4534-b477-1757bfb220a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:46.239281 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10b642-2983-4534-b477-1757bfb220a3 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:46.245195 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e280c8-8bf1-4cab-b85e-a234c8dd8931 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:46.268130 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 111/223] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 27 09:38:46 2022] POST /identity/v3/users => generated 297 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:38:46.269506 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10b642-2983-4534-b477-1757bfb220a3 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:46.295729 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d76d7b-5253-40ab-9361-e7799d68a452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:46.296734 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d76d7b-5253-40ab-9361-e7799d68a452 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:46.297140 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d76d7b-5253-40ab-9361-e7799d68a452 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:46.297590 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d76d7b-5253-40ab-9361-e7799d68a452 None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:46.298884 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d76d7b-5253-40ab-9361-e7799d68a452 None admin] RBAC: Adding query filter params (name=member) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:46.299258 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d76d7b-5253-40ab-9361-e7799d68a452 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:46.301090 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d76d7b-5253-40ab-9361-e7799d68a452 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:46.314836 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 113/224] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 27 09:38:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:46.314836 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d76d7b-5253-40ab-9361-e7799d68a452 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:46.322403 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:46.336916 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:46.453895 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10b642-2983-4534-b477-1757bfb220a3 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:46.493756 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d76d7b-5253-40ab-9361-e7799d68a452 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:46.510748 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823af32-3794-41d5-9276-2a55e51b5667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:46.511931 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823af32-3794-41d5-9276-2a55e51b5667 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:46.512382 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823af32-3794-41d5-9276-2a55e51b5667 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:46.512835 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823af32-3794-41d5-9276-2a55e51b5667 None admin] PATH_INFO: `/v3/users/a377a147804e4fe197498ae5a76b7729` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:46.515130 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823af32-3794-41d5-9276-2a55e51b5667 None admin] RBAC: Authorizing `identity:get_user(user_id=a377a147804e4fe197498ae5a76b7729)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:46.517179 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823af32-3794-41d5-9276-2a55e51b5667 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:46.520429 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 112/225] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:38:46 2022] GET /identity/v3/users/a377a147804e4fe197498ae5a76b7729 => generated 283 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:46.527049 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823af32-3794-41d5-9276-2a55e51b5667 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:46.579867 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59af59-96d4-4c89-80ac-e2299bafced0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:46.581582 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59af59-96d4-4c89-80ac-e2299bafced0 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:46.582425 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59af59-96d4-4c89-80ac-e2299bafced0 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:46.582987 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59af59-96d4-4c89-80ac-e2299bafced0 None admin] PATH_INFO: `/v3/users/a377a147804e4fe197498ae5a76b7729` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:46.585307 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59af59-96d4-4c89-80ac-e2299bafced0 None admin] RBAC: Authorizing `identity:get_user(user_id=a377a147804e4fe197498ae5a76b7729)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:46.589016 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59af59-96d4-4c89-80ac-e2299bafced0 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:46.591889 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 114/226] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:38:46 2022] GET /identity/v3/users/a377a147804e4fe197498ae5a76b7729 => generated 283 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:46.592560 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59af59-96d4-4c89-80ac-e2299bafced0 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:46.714807 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:46.731849 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:46.737083 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823af32-3794-41d5-9276-2a55e51b5667 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:46.786397 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59af59-96d4-4c89-80ac-e2299bafced0 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:46.805503 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b66a93-a6d6-4d68-b5ea-745613d2b047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:46.806270 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b66a93-a6d6-4d68-b5ea-745613d2b047 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:46.806757 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b66a93-a6d6-4d68-b5ea-745613d2b047 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:46.807255 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b66a93-a6d6-4d68-b5ea-745613d2b047 None admin] PATH_INFO: `/v3/users/e1e5e4ffefae4cde9b15505952ca0644` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:46.833347 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b66a93-a6d6-4d68-b5ea-745613d2b047 None admin] RBAC: Authorizing `identity:get_user(user_id=e1e5e4ffefae4cde9b15505952ca0644)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:46.835678 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b66a93-a6d6-4d68-b5ea-745613d2b047 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:46.838732 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 113/227] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:38:46 2022] GET /identity/v3/users/e1e5e4ffefae4cde9b15505952ca0644 => generated 297 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:46.840033 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b66a93-a6d6-4d68-b5ea-745613d2b047 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:46.852549 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cda23d-3f08-47c7-86dd-e67cd264b101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:46.853210 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cda23d-3f08-47c7-86dd-e67cd264b101 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:46.853493 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cda23d-3f08-47c7-86dd-e67cd264b101 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:46.853771 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cda23d-3f08-47c7-86dd-e67cd264b101 None admin] PATH_INFO: `/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:46.855575 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cda23d-3f08-47c7-86dd-e67cd264b101 None admin] RBAC: Authorizing `identity:get_project(project_id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:46.856627 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cda23d-3f08-47c7-86dd-e67cd264b101 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:46.858748 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 115/228] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:38:46 2022] GET /identity/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:46.859373 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cda23d-3f08-47c7-86dd-e67cd264b101 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:46.983464 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b66a93-a6d6-4d68-b5ea-745613d2b047 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:47.016561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cda23d-3f08-47c7-86dd-e67cd264b101 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:47.027774 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f26a8-6d43-4ce6-91c7-fee017b3430e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:47.028611 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f26a8-6d43-4ce6-91c7-fee017b3430e None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:47.028886 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f26a8-6d43-4ce6-91c7-fee017b3430e None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:47.029153 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f26a8-6d43-4ce6-91c7-fee017b3430e None admin] PATH_INFO: `/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:47.030371 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f26a8-6d43-4ce6-91c7-fee017b3430e None admin] RBAC: Authorizing `identity:get_project(project_id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:47.032057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f26a8-6d43-4ce6-91c7-fee017b3430e None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:47.034353 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 114/229] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:38:46 2022] GET /identity/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:47.034999 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f26a8-6d43-4ce6-91c7-fee017b3430e None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:47.060750 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31d089-e71a-4689-9a94-bbf63fd8f2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:47.061388 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31d089-e71a-4689-9a94-bbf63fd8f2d4 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:47.061669 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31d089-e71a-4689-9a94-bbf63fd8f2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:47.061918 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31d089-e71a-4689-9a94-bbf63fd8f2d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:47.072183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:47.073516 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:47.143878 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31d089-e71a-4689-9a94-bbf63fd8f2d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:47.145300 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31d089-e71a-4689-9a94-bbf63fd8f2d4 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:47.165111 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f26a8-6d43-4ce6-91c7-fee017b3430e None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:47.206562 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9015ff-d8b9-443b-91bb-29b7f785f11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:47.207547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9015ff-d8b9-443b-91bb-29b7f785f11b None admin] REQUEST_METHOD: `PUT` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:47.207825 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9015ff-d8b9-443b-91bb-29b7f785f11b None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:47.208570 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9015ff-d8b9-443b-91bb-29b7f785f11b None admin] PATH_INFO: `/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d/users/a377a147804e4fe197498ae5a76b7729/roles/3c0df08d0ed0435597a1d69ed45a49d4` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:47.211428 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9015ff-d8b9-443b-91bb-29b7f785f11b None admin] RBAC: Authorizing `identity:create_grant(project_id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d, user_id=a377a147804e4fe197498ae5a76b7729, role_id=3c0df08d0ed0435597a1d69ed45a49d4)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:47.212975 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9015ff-d8b9-443b-91bb-29b7f785f11b None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:47.233759 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 115/230] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 27 09:38:47 2022] PUT /identity/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d/users/a377a147804e4fe197498ae5a76b7729/roles/3c0df08d0ed0435597a1d69ed45a49d4 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 09:38:47.234246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9015ff-d8b9-443b-91bb-29b7f785f11b None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:47.262108 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 116/231] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:38:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:38:47.268240 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31d089-e71a-4689-9a94-bbf63fd8f2d4 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:47.331553 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:47.447458 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31d089-e71a-4689-9a94-bbf63fd8f2d4 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:47.472308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:47.508025 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9015ff-d8b9-443b-91bb-29b7f785f11b None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:47.538435 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c43dd-192e-4610-91d2-6ad9cf4dafb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:47.539437 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c43dd-192e-4610-91d2-6ad9cf4dafb4 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:47.539853 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c43dd-192e-4610-91d2-6ad9cf4dafb4 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:47.540258 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c43dd-192e-4610-91d2-6ad9cf4dafb4 None admin] PATH_INFO: `/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:47.546281 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c43dd-192e-4610-91d2-6ad9cf4dafb4 None admin] RBAC: Authorizing `identity:get_project(project_id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:47.549068 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c43dd-192e-4610-91d2-6ad9cf4dafb4 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:47.551032 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 117/232] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:38:47 2022] GET /identity/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:47.563287 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c43dd-192e-4610-91d2-6ad9cf4dafb4 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:47.642638 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf34d1-e769-4462-9fdb-20616f783412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:47.644096 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf34d1-e769-4462-9fdb-20616f783412 None admin] REQUEST_METHOD: `PUT` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:47.644695 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf34d1-e769-4462-9fdb-20616f783412 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:47.645291 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf34d1-e769-4462-9fdb-20616f783412 None admin] PATH_INFO: `/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d/users/a377a147804e4fe197498ae5a76b7729/roles/7cc7d3c85c794033b590117321e97ccf` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:47.649885 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf34d1-e769-4462-9fdb-20616f783412 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d, user_id=a377a147804e4fe197498ae5a76b7729, role_id=7cc7d3c85c794033b590117321e97ccf)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:47.653656 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf34d1-e769-4462-9fdb-20616f783412 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:47.679757 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 116/233] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 27 09:38:47 2022] PUT /identity/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d/users/a377a147804e4fe197498ae5a76b7729/roles/7cc7d3c85c794033b590117321e97ccf => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 09:38:47.791762 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c43dd-192e-4610-91d2-6ad9cf4dafb4 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:47.808020 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:47.852762 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91743a9-7bfc-45d3-936d-a449d1f447b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:47.853406 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91743a9-7bfc-45d3-936d-a449d1f447b3 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:47.853683 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91743a9-7bfc-45d3-936d-a449d1f447b3 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:47.853955 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91743a9-7bfc-45d3-936d-a449d1f447b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:47.854987 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91743a9-7bfc-45d3-936d-a449d1f447b3 None admin] RBAC: Adding query filter params (role.id=378cb7fb6a4e4e5e89ab9a0ecb09d86b, scope.project.id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d, user.id=e1e5e4ffefae4cde9b15505952ca0644) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:47.855307 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91743a9-7bfc-45d3-936d-a449d1f447b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:47.856984 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91743a9-7bfc-45d3-936d-a449d1f447b3 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:47.864353 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 118/234] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:38:47 2022] GET /identity/v3/role_assignments?user.id=e1e5e4ffefae4cde9b15505952ca0644&scope.project.id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d&role.id=378cb7fb6a4e4e5e89ab9a0ecb09d86b => generated 259 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:38:50.174984 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28597271-5b23-40b6-bf60-a7b334d153dc None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:50.175832 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28597271-5b23-40b6-bf60-a7b334d153dc None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:50.175832 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28597271-5b23-40b6-bf60-a7b334d153dc None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:50.177003 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 117/235] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:38:50.186103 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372621e-9419-4e0a-8320-1137a09ab733 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:50.186928 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372621e-9419-4e0a-8320-1137a09ab733 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:50.186928 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372621e-9419-4e0a-8320-1137a09ab733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:50.211416 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-8372621e-9419-4e0a-8320-1137a09ab733 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:50.212842 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-8372621e-9419-4e0a-8320-1137a09ab733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:50.324318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 119/236] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:50.542311 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5c9fa-8812-41fd-ac1e-fcb6a79861d8 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:50.542573 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5c9fa-8812-41fd-ac1e-fcb6a79861d8 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:50.542884 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5c9fa-8812-41fd-ac1e-fcb6a79861d8 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:50.544269 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 118/237] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:38:50.551591 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614eb4e-9bf7-4d26-be98-8972e06f207a None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:50.552044 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614eb4e-9bf7-4d26-be98-8972e06f207a None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:50.552189 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614eb4e-9bf7-4d26-be98-8972e06f207a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:50.585300 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-d614eb4e-9bf7-4d26-be98-8972e06f207a None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:50.587393 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-d614eb4e-9bf7-4d26-be98-8972e06f207a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:50.687673 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 120/238] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:50.901308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82ec15-ecbc-4cb4-8120-6e919677746f None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:50.901541 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82ec15-ecbc-4cb4-8120-6e919677746f None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:50.901725 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82ec15-ecbc-4cb4-8120-6e919677746f None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:50.903630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 119/239] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:50.909877 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e397ec-9c36-4824-9ccb-1f1fdc24847d None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:50.910206 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e397ec-9c36-4824-9ccb-1f1fdc24847d None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:50.910436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e397ec-9c36-4824-9ccb-1f1fdc24847d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:50.936151 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-f8e397ec-9c36-4824-9ccb-1f1fdc24847d None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:50.937442 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-f8e397ec-9c36-4824-9ccb-1f1fdc24847d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:50.965634 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:51.041619 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 121/240] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:51.065317 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82ec15-ecbc-4cb4-8120-6e919677746f None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:51.160427 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e397ec-9c36-4824-9ccb-1f1fdc24847d None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:51.258794 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82ec15-ecbc-4cb4-8120-6e919677746f None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:51.319551 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b979b4-bbeb-4d2f-bf37-86a21f3ca0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:51.322445 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b979b4-bbeb-4d2f-bf37-86a21f3ca0ff None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:51.322445 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b979b4-bbeb-4d2f-bf37-86a21f3ca0ff None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:51.322445 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b979b4-bbeb-4d2f-bf37-86a21f3ca0ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:51.334730 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b979b4-bbeb-4d2f-bf37-86a21f3ca0ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:38:51.344249 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-33b979b4-bbeb-4d2f-bf37-86a21f3ca0ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 09:38:51.344249 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:51.344249 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:51.344249 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:51.344249 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:51.344249 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:51.344249 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:51.344249 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:51.344249 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:51.344249 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:51.344249 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:51.344249 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:51.344249 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:38:51.344249 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:38:51.344249 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:38:51.344249 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:38:51.346120 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:38:51.346120 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:38:51.346120 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:38:51.346120 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:38:51.346120 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:51.346120 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:51.346120 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:51.346120 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:51.346120 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:51.346120 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:51.346120 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:51.346120 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:51.346120 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:51.346120 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:51.346120 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:51.346120 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:51.348019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:51.348019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:51.348019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:51.348019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:51.348019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:38:51.348019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:38:51.348019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:38:51.348019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:38:51.348019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:38:51.348019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:38:51.348019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 09:38:51.348019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:38:51.348019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 120/241] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:38:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:38:51.354834 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b979b4-bbeb-4d2f-bf37-86a21f3ca0ff None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:51.364653 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:51.434601 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e397ec-9c36-4824-9ccb-1f1fdc24847d None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:51.466187 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b979b4-bbeb-4d2f-bf37-86a21f3ca0ff None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:51.472233 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8c100-9195-403c-a278-3490048a00da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:51.472884 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8c100-9195-403c-a278-3490048a00da None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:51.473154 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8c100-9195-403c-a278-3490048a00da None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:51.473420 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8c100-9195-403c-a278-3490048a00da None admin] PATH_INFO: `/v3/domains/default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:51.474994 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8c100-9195-403c-a278-3490048a00da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:51.476609 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8c100-9195-403c-a278-3490048a00da None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:51.478588 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 122/242] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:38:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:38:51.479159 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8c100-9195-403c-a278-3490048a00da None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:51.503466 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3eb82-ba40-42ee-bf8f-daa9e8720118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:51.504104 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3eb82-ba40-42ee-bf8f-daa9e8720118 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:51.504382 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3eb82-ba40-42ee-bf8f-daa9e8720118 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:51.504653 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3eb82-ba40-42ee-bf8f-daa9e8720118 None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:51.505335 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc3eb82-ba40-42ee-bf8f-daa9e8720118 None admin] RBAC: Adding query filter params (name=reader) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:51.505690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc3eb82-ba40-42ee-bf8f-daa9e8720118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:51.508990 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc3eb82-ba40-42ee-bf8f-daa9e8720118 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:51.511615 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:51.517023 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 121/243] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 27 09:38:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:51.522416 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3eb82-ba40-42ee-bf8f-daa9e8720118 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:51.596850 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8c100-9195-403c-a278-3490048a00da None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:51.603232 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:51.637327 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dd750-30fc-4064-9090-d603ca54e4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:51.638227 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dd750-30fc-4064-9090-d603ca54e4ef None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:51.638639 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dd750-30fc-4064-9090-d603ca54e4ef None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:51.639112 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dd750-30fc-4064-9090-d603ca54e4ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:51.642667 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3eb82-ba40-42ee-bf8f-daa9e8720118 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:51.651802 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5dd750-30fc-4064-9090-d603ca54e4ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:38:51.656981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-4a5dd750-30fc-4064-9090-d603ca54e4ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 09:38:51.656981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:51.656981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:51.656981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:51.656981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:51.656981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:51.656981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:51.656981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:51.656981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:51.656981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:51.656981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:51.656981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:51.656981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:38:51.656981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:38:51.656981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:38:51.656981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:38:51.657902 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:38:51.657902 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:38:51.657902 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:38:51.657902 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:38:51.657902 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:51.657902 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:51.657902 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:51.657902 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:51.657902 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:51.657902 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:51.657902 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:51.657902 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:51.657902 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:51.657902 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:51.657902 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:51.657902 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:51.658666 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:51.658666 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:51.658666 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:51.658666 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:51.658666 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:38:51.658666 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:38:51.658666 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:38:51.658666 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:38:51.658666 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:38:51.658666 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:38:51.658666 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 09:38:51.658666 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:38:51.661568 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 123/244] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 27 09:38:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:38:51.662811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dd750-30fc-4064-9090-d603ca54e4ef None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:51.686112 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a547f-7bfb-49cf-b109-96b54d4af031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:51.686662 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a547f-7bfb-49cf-b109-96b54d4af031 None admin] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:51.686975 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a547f-7bfb-49cf-b109-96b54d4af031 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:51.687256 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a547f-7bfb-49cf-b109-96b54d4af031 None admin] PATH_INFO: `/v3/users` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:51.687921 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a547f-7bfb-49cf-b109-96b54d4af031 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:51.689450 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a547f-7bfb-49cf-b109-96b54d4af031 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:51.716279 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 122/245] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 27 09:38:51 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:38:51.717140 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a547f-7bfb-49cf-b109-96b54d4af031 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:51.781101 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:51.798078 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dd750-30fc-4064-9090-d603ca54e4ef None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:51.840316 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545488c-2f6f-4bbb-8e87-86648ac487cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:51.841124 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545488c-2f6f-4bbb-8e87-86648ac487cb None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:51.841303 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545488c-2f6f-4bbb-8e87-86648ac487cb None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:51.841583 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545488c-2f6f-4bbb-8e87-86648ac487cb None admin] PATH_INFO: `/v3/users/b297e89609a34cd58f1976aed9e98475` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:51.853474 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a547f-7bfb-49cf-b109-96b54d4af031 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:51.858186 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545488c-2f6f-4bbb-8e87-86648ac487cb None admin] RBAC: Authorizing `identity:get_user(user_id=b297e89609a34cd58f1976aed9e98475)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:51.859802 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545488c-2f6f-4bbb-8e87-86648ac487cb None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:51.861877 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 124/246] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:38:51 2022] GET /identity/v3/users/b297e89609a34cd58f1976aed9e98475 => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:51.868341 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1385add-0b52-4bcf-9fc8-6a974b7feb08 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:51.868663 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1385add-0b52-4bcf-9fc8-6a974b7feb08 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:51.868902 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1385add-0b52-4bcf-9fc8-6a974b7feb08 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:51.870714 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 125/247] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:51.871611 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1385add-0b52-4bcf-9fc8-6a974b7feb08 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:51.888164 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:51.903090 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764414bd-5031-40a0-9839-63f36f8801e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:51.904343 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764414bd-5031-40a0-9839-63f36f8801e9 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:51.904880 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764414bd-5031-40a0-9839-63f36f8801e9 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:51.905363 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764414bd-5031-40a0-9839-63f36f8801e9 None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:51.906239 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764414bd-5031-40a0-9839-63f36f8801e9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:51.906754 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764414bd-5031-40a0-9839-63f36f8801e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:51.908828 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764414bd-5031-40a0-9839-63f36f8801e9 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:51.920904 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 123/248] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:38:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:51.922752 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064fc57-b4f1-4b7c-9b66-3e7f76657fca None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:51.923276 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064fc57-b4f1-4b7c-9b66-3e7f76657fca None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:51.923778 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064fc57-b4f1-4b7c-9b66-3e7f76657fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:51.944951 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-6064fc57-b4f1-4b7c-9b66-3e7f76657fca None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:51.946609 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-6064fc57-b4f1-4b7c-9b66-3e7f76657fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:52.008784 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1385add-0b52-4bcf-9fc8-6a974b7feb08 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:52.056139 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693776af-e285-4a5f-ba3a-ef6dd3f1ff20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:52.056695 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 124/249] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:52.057216 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693776af-e285-4a5f-ba3a-ef6dd3f1ff20 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:52.057514 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693776af-e285-4a5f-ba3a-ef6dd3f1ff20 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:52.057514 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693776af-e285-4a5f-ba3a-ef6dd3f1ff20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:52.063825 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064fc57-b4f1-4b7c-9b66-3e7f76657fca None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:52.085839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:52.211204 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693776af-e285-4a5f-ba3a-ef6dd3f1ff20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:52.214102 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693776af-e285-4a5f-ba3a-ef6dd3f1ff20 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:52.250859 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064fc57-b4f1-4b7c-9b66-3e7f76657fca None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:52.284795 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:52.322702 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac09e9-9231-4fad-be3b-e4be2adfb79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:52.324288 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac09e9-9231-4fad-be3b-e4be2adfb79d None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:52.325010 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac09e9-9231-4fad-be3b-e4be2adfb79d None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:52.325730 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac09e9-9231-4fad-be3b-e4be2adfb79d None admin] PATH_INFO: `/v3/users/a377a147804e4fe197498ae5a76b7729` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:52.328190 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac09e9-9231-4fad-be3b-e4be2adfb79d None admin] RBAC: Authorizing `identity:get_user(user_id=a377a147804e4fe197498ae5a76b7729)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:52.331465 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac09e9-9231-4fad-be3b-e4be2adfb79d None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:52.335114 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 125/250] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:38:52 2022] GET /identity/v3/users/a377a147804e4fe197498ae5a76b7729 => generated 283 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:52.337576 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94930c-dd73-438a-a0c6-977ff7ae7e7c None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:52.338306 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94930c-dd73-438a-a0c6-977ff7ae7e7c None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:52.339033 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94930c-dd73-438a-a0c6-977ff7ae7e7c None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:52.341805 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 126/251] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:52.343523 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94930c-dd73-438a-a0c6-977ff7ae7e7c None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:52.438857 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 126/252] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:38:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:38:52.441066 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbff7e4-8c65-4157-b22b-74115533c1ad None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:52.441607 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbff7e4-8c65-4157-b22b-74115533c1ad None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:52.442031 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbff7e4-8c65-4157-b22b-74115533c1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:52.492163 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-5bbff7e4-8c65-4157-b22b-74115533c1ad None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:52.495785 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-5bbff7e4-8c65-4157-b22b-74115533c1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:52.552034 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94930c-dd73-438a-a0c6-977ff7ae7e7c None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:52.586423 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:52.635685 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2573c2-6879-4a5c-852c-35b20cb4f0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:52.636425 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 127/253] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:52.641876 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbff7e4-8c65-4157-b22b-74115533c1ad None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:52.643248 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2573c2-6879-4a5c-852c-35b20cb4f0b1 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:52.644137 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2573c2-6879-4a5c-852c-35b20cb4f0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:52.644863 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2573c2-6879-4a5c-852c-35b20cb4f0b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:52.792479 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:52.828768 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2573c2-6879-4a5c-852c-35b20cb4f0b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:52.832249 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2573c2-6879-4a5c-852c-35b20cb4f0b1 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:52.840125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbff7e4-8c65-4157-b22b-74115533c1ad None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:52.911216 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077c017-290f-4886-8534-5e465e086237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:52.912493 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077c017-290f-4886-8534-5e465e086237 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:52.913199 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077c017-290f-4886-8534-5e465e086237 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:52.913557 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077c017-290f-4886-8534-5e465e086237 None admin] PATH_INFO: `/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:52.915819 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077c017-290f-4886-8534-5e465e086237 None admin] RBAC: Authorizing `identity:get_project(project_id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:52.918593 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077c017-290f-4886-8534-5e465e086237 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:52.922344 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 128/254] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:38:52 2022] GET /identity/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:52.923908 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077c017-290f-4886-8534-5e465e086237 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:53.013698 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:53.051916 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 127/255] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:38:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 709 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:38:53.054643 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2573c2-6879-4a5c-852c-35b20cb4f0b1 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:53.177078 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077c017-290f-4886-8534-5e465e086237 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:53.238280 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:53.268689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2573c2-6879-4a5c-852c-35b20cb4f0b1 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:53.295112 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31ff90-b77c-4b6a-b924-180855953830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:53.296121 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31ff90-b77c-4b6a-b924-180855953830 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:53.296580 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31ff90-b77c-4b6a-b924-180855953830 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:53.297037 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31ff90-b77c-4b6a-b924-180855953830 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:53.316114 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31ff90-b77c-4b6a-b924-180855953830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:38:53.326499 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-0b31ff90-b77c-4b6a-b924-180855953830 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:38:53.326499 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:53.326499 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:53.326499 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:53.326499 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:53.326499 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:53.326499 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:53.326499 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:53.326499 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:53.326499 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:53.326499 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:53.326499 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:53.326499 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:38:53.326499 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:38:53.326499 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:38:53.326499 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:38:53.328562 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:38:53.328562 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:38:53.328562 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:38:53.328562 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:38:53.328562 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:53.328562 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:53.328562 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:53.328562 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:53.328562 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:53.328562 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:53.328562 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:53.328562 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:53.328562 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:53.328562 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:53.328562 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:53.328562 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:53.330374 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:53.330374 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:53.330374 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:53.330374 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:53.330374 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:38:53.330374 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:38:53.330374 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:38:53.330374 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:38:53.330374 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:38:53.330374 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:38:53.330374 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:38:53.330374 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:38:53.330374 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 129/256] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:38:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:38:53.330374 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31ff90-b77c-4b6a-b924-180855953830 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:53.352969 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f49899-6998-452c-83bf-93ceb2a2dabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:53.354988 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f49899-6998-452c-83bf-93ceb2a2dabb None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:53.355761 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f49899-6998-452c-83bf-93ceb2a2dabb None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:53.356515 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f49899-6998-452c-83bf-93ceb2a2dabb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:53.358093 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f49899-6998-452c-83bf-93ceb2a2dabb None admin] RBAC: Adding query filter params (role.id=2b7fd974b36e410db7b0003344b6a5f8, scope.project.id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d, user.id=b297e89609a34cd58f1976aed9e98475) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:53.359011 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f49899-6998-452c-83bf-93ceb2a2dabb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:53.361974 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f49899-6998-452c-83bf-93ceb2a2dabb None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:53.373681 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 128/257] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:38:53 2022] GET /identity/v3/role_assignments?user.id=b297e89609a34cd58f1976aed9e98475&scope.project.id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d&role.id=2b7fd974b36e410db7b0003344b6a5f8 => generated 259 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:53.375395 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f49899-6998-452c-83bf-93ceb2a2dabb None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:53.573080 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31ff90-b77c-4b6a-b924-180855953830 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:53.590883 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:53.614197 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f49899-6998-452c-83bf-93ceb2a2dabb None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:53.690318 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54324434-9174-4f3a-b3e0-c39b6a2f819b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:53.692112 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54324434-9174-4f3a-b3e0-c39b6a2f819b None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:53.692970 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54324434-9174-4f3a-b3e0-c39b6a2f819b None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:53.693872 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54324434-9174-4f3a-b3e0-c39b6a2f819b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:53.707179 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e99bed-f1ff-4b73-b24a-0065ac486ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:53.707857 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e99bed-f1ff-4b73-b24a-0065ac486ad9 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:53.708174 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e99bed-f1ff-4b73-b24a-0065ac486ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:53.708415 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e99bed-f1ff-4b73-b24a-0065ac486ad9 None admin] PATH_INFO: `/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:53.715713 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e99bed-f1ff-4b73-b24a-0065ac486ad9 None admin] RBAC: Authorizing `identity:get_project(project_id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:53.717258 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e99bed-f1ff-4b73-b24a-0065ac486ad9 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:53.718514 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54324434-9174-4f3a-b3e0-c39b6a2f819b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:38:53.719384 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 130/258] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:38:53 2022] GET /identity/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d => generated 302 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:53.720307 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e99bed-f1ff-4b73-b24a-0065ac486ad9 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:53.730498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-54324434-9174-4f3a-b3e0-c39b6a2f819b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:38:53.730498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:53.730498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:53.730498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:53.730498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:53.730498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:53.730498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:53.730498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:53.730498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:53.730498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:53.730498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:53.730498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:53.730498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:38:53.730498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:38:53.730498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:38:53.730498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:38:53.732278 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:38:53.732278 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:38:53.732278 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:38:53.732278 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:38:53.732278 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:53.732278 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:53.732278 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:53.732278 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:53.732278 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:53.732278 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:53.732278 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:53.732278 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:53.732278 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:53.732278 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:53.732278 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:53.732278 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:53.733928 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:53.733928 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:53.733928 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:53.733928 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:53.733928 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:38:53.733928 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:38:53.733928 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:38:53.733928 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:38:53.733928 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:38:53.733928 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:38:53.733928 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:38:53.733928 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:38:53.739701 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 129/259] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 27 09:38:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:38:53.742038 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54324434-9174-4f3a-b3e0-c39b6a2f819b None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:53.803214 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:53.957715 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54324434-9174-4f3a-b3e0-c39b6a2f819b None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:54.006135 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e7d59-4756-4b41-a3b9-d3a9f80c5bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:54.007946 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e7d59-4756-4b41-a3b9-d3a9f80c5bc4 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:54.009090 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e7d59-4756-4b41-a3b9-d3a9f80c5bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:54.009874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e7d59-4756-4b41-a3b9-d3a9f80c5bc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:54.012120 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e7d59-4756-4b41-a3b9-d3a9f80c5bc4 None admin] RBAC: Adding query filter params (role.id=3c0df08d0ed0435597a1d69ed45a49d4, scope.project.id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d, user.id=a377a147804e4fe197498ae5a76b7729) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:54.013004 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e7d59-4756-4b41-a3b9-d3a9f80c5bc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:54.014071 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e99bed-f1ff-4b73-b24a-0065ac486ad9 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:54.016552 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e7d59-4756-4b41-a3b9-d3a9f80c5bc4 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:54.029924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 130/260] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:38:53 2022] GET /identity/v3/role_assignments?user.id=a377a147804e4fe197498ae5a76b7729&scope.project.id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d&role.id=3c0df08d0ed0435597a1d69ed45a49d4 => generated 608 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:54.031885 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e7d59-4756-4b41-a3b9-d3a9f80c5bc4 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:54.131388 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:54.144070 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5707b51-c617-49a0-b25a-94caf3c9c083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:54.145139 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5707b51-c617-49a0-b25a-94caf3c9c083 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:54.145593 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5707b51-c617-49a0-b25a-94caf3c9c083 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:54.146032 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5707b51-c617-49a0-b25a-94caf3c9c083 None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:54.148317 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5707b51-c617-49a0-b25a-94caf3c9c083 None admin] RBAC: Adding query filter params (name=member) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:54.148845 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5707b51-c617-49a0-b25a-94caf3c9c083 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:54.151459 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5707b51-c617-49a0-b25a-94caf3c9c083 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:54.173989 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e7d59-4756-4b41-a3b9-d3a9f80c5bc4 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:54.202070 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 131/261] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 27 09:38:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 482 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:54.216593 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5707b51-c617-49a0-b25a-94caf3c9c083 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:54.247552 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75218b-ce9b-439f-a66a-5f5b351b2c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:54.248707 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75218b-ce9b-439f-a66a-5f5b351b2c90 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:54.249300 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75218b-ce9b-439f-a66a-5f5b351b2c90 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:54.249853 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75218b-ce9b-439f-a66a-5f5b351b2c90 None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:54.251240 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac75218b-ce9b-439f-a66a-5f5b351b2c90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:54.251856 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac75218b-ce9b-439f-a66a-5f5b351b2c90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:54.254617 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac75218b-ce9b-439f-a66a-5f5b351b2c90 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:54.271496 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 131/262] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:38:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:54.287821 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75218b-ce9b-439f-a66a-5f5b351b2c90 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:54.328551 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:54.474791 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5707b51-c617-49a0-b25a-94caf3c9c083 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:54.520310 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59bc29-d311-441d-9d52-53d822c7ea64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:54.520978 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59bc29-d311-441d-9d52-53d822c7ea64 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:54.521292 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59bc29-d311-441d-9d52-53d822c7ea64 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:54.521569 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59bc29-d311-441d-9d52-53d822c7ea64 None admin] PATH_INFO: `/v3/users/e1e5e4ffefae4cde9b15505952ca0644` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:54.524449 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59bc29-d311-441d-9d52-53d822c7ea64 None admin] RBAC: Authorizing `identity:get_user(user_id=e1e5e4ffefae4cde9b15505952ca0644)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:54.525977 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59bc29-d311-441d-9d52-53d822c7ea64 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:54.527881 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 132/263] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:38:54 2022] GET /identity/v3/users/e1e5e4ffefae4cde9b15505952ca0644 => generated 297 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:54.541301 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59bc29-d311-441d-9d52-53d822c7ea64 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:54.665117 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75218b-ce9b-439f-a66a-5f5b351b2c90 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:54.736333 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3188ae-f8c0-457d-8861-96489b5dcc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:54.736894 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3188ae-f8c0-457d-8861-96489b5dcc0a None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:54.737169 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3188ae-f8c0-457d-8861-96489b5dcc0a None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:54.737442 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3188ae-f8c0-457d-8861-96489b5dcc0a None admin] PATH_INFO: `/v3/users/a377a147804e4fe197498ae5a76b7729` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:54.738689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3188ae-f8c0-457d-8861-96489b5dcc0a None admin] RBAC: Authorizing `identity:get_user(user_id=a377a147804e4fe197498ae5a76b7729)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:54.740305 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3188ae-f8c0-457d-8861-96489b5dcc0a None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:54.743632 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 132/264] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:38:54 2022] GET /identity/v3/users/a377a147804e4fe197498ae5a76b7729 => generated 283 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:38:54.756534 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3188ae-f8c0-457d-8861-96489b5dcc0a None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:54.762319 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:54.812231 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59bc29-d311-441d-9d52-53d822c7ea64 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:54.816446 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:54.952373 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe465dd7-b462-476f-969f-7be6508cf939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:54.953056 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe465dd7-b462-476f-969f-7be6508cf939 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:54.953337 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe465dd7-b462-476f-969f-7be6508cf939 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:54.953618 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe465dd7-b462-476f-969f-7be6508cf939 None admin] PATH_INFO: `/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:54.958084 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe465dd7-b462-476f-969f-7be6508cf939 None admin] RBAC: Authorizing `identity:get_project(project_id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:54.959821 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe465dd7-b462-476f-969f-7be6508cf939 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:54.961908 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 133/265] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:38:54 2022] GET /identity/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d => generated 302 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:54.968484 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe465dd7-b462-476f-969f-7be6508cf939 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:55.120186 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3188ae-f8c0-457d-8861-96489b5dcc0a None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:55.227513 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe465dd7-b462-476f-969f-7be6508cf939 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:55.244958 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2323db-b971-4a81-8641-17373f04cde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:55.250731 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2323db-b971-4a81-8641-17373f04cde9 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:55.251645 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2323db-b971-4a81-8641-17373f04cde9 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:55.252344 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2323db-b971-4a81-8641-17373f04cde9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:55.355117 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369a07f-e674-432b-b632-9997f5ecd286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:55.355825 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369a07f-e674-432b-b632-9997f5ecd286 None admin] REQUEST_METHOD: `PUT` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:55.356109 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369a07f-e674-432b-b632-9997f5ecd286 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:55.356387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369a07f-e674-432b-b632-9997f5ecd286 None admin] PATH_INFO: `/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d/users/e1e5e4ffefae4cde9b15505952ca0644/roles/378cb7fb6a4e4e5e89ab9a0ecb09d86b` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:55.364604 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369a07f-e674-432b-b632-9997f5ecd286 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d, user_id=e1e5e4ffefae4cde9b15505952ca0644, role_id=378cb7fb6a4e4e5e89ab9a0ecb09d86b)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:55.366180 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369a07f-e674-432b-b632-9997f5ecd286 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:55.405651 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 134/266] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 27 09:38:54 2022] PUT /identity/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d/users/e1e5e4ffefae4cde9b15505952ca0644/roles/378cb7fb6a4e4e5e89ab9a0ecb09d86b => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 09:38:55.431204 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2323db-b971-4a81-8641-17373f04cde9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:55.434627 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2323db-b971-4a81-8641-17373f04cde9 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:55.451222 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:55.457673 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e57c50-3b3b-4116-893d-e9f1fda21422 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:55.458019 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e57c50-3b3b-4116-893d-e9f1fda21422 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:55.458343 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e57c50-3b3b-4116-893d-e9f1fda21422 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:55.460279 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 135/267] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:38:55.467368 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604d8c7-8eb5-4ba1-860d-2e236ce7186b None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:55.467718 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604d8c7-8eb5-4ba1-860d-2e236ce7186b None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:55.467919 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604d8c7-8eb5-4ba1-860d-2e236ce7186b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:55.519990 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-4604d8c7-8eb5-4ba1-860d-2e236ce7186b None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:55.522790 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-4604d8c7-8eb5-4ba1-860d-2e236ce7186b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:55.575491 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:55.655907 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 133/268] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:38:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 900 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:38:55.663982 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2323db-b971-4a81-8641-17373f04cde9 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:55.679083 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 136/269] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:38:55.848881 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2323db-b971-4a81-8641-17373f04cde9 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:55.851799 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:55.909400 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c3b5b-4df8-447a-ba42-a10da6158007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:55.909971 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c3b5b-4df8-447a-ba42-a10da6158007 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:55.910250 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c3b5b-4df8-447a-ba42-a10da6158007 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:55.910523 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c3b5b-4df8-447a-ba42-a10da6158007 None admin] PATH_INFO: `/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:55.912324 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c3b5b-4df8-447a-ba42-a10da6158007 None admin] RBAC: Authorizing `identity:get_project(project_id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:55.914022 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c3b5b-4df8-447a-ba42-a10da6158007 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:55.916244 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 134/270] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:38:55 2022] GET /identity/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:38:55.926638 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604d8c7-8eb5-4ba1-860d-2e236ce7186b None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:56.053328 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604d8c7-8eb5-4ba1-860d-2e236ce7186b None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:56.119163 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767606f-1646-444d-886f-112c0d057035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:56.119811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767606f-1646-444d-886f-112c0d057035 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:56.120087 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767606f-1646-444d-886f-112c0d057035 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:56.120363 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767606f-1646-444d-886f-112c0d057035 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:56.121139 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767606f-1646-444d-886f-112c0d057035 None admin] RBAC: Adding query filter params (role.id=7cc7d3c85c794033b590117321e97ccf, scope.project.id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d, user.id=a377a147804e4fe197498ae5a76b7729) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:56.121448 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767606f-1646-444d-886f-112c0d057035 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:56.123010 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767606f-1646-444d-886f-112c0d057035 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:56.130475 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 137/271] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:38:55 2022] GET /identity/v3/role_assignments?user.id=a377a147804e4fe197498ae5a76b7729&scope.project.id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d&role.id=7cc7d3c85c794033b590117321e97ccf => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:56.258578 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c3b5b-4df8-447a-ba42-a10da6158007 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:56.431549 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c3b5b-4df8-447a-ba42-a10da6158007 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:56.494466 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b0f1a-29bc-459a-95d4-674f4e589464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:56.495168 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b0f1a-29bc-459a-95d4-674f4e589464 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:56.495443 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b0f1a-29bc-459a-95d4-674f4e589464 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:56.495707 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b0f1a-29bc-459a-95d4-674f4e589464 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:56.515874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b0f1a-29bc-459a-95d4-674f4e589464 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:38:56.520850 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-8e2b0f1a-29bc-459a-95d4-674f4e589464 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:38:56.520850 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:56.520850 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:56.520850 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:56.520850 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:56.520850 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:56.520850 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:56.520850 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:56.520850 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:56.520850 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:56.520850 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:56.520850 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:56.520850 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:38:56.520850 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:38:56.520850 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:38:56.520850 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:38:56.523923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:38:56.523923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:38:56.523923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:38:56.523923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:38:56.523923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:56.523923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:56.523923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:56.523923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:56.523923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:56.523923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:56.523923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:56.523923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:56.523923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:56.523923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:56.523923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:56.523923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:56.525766 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:56.525766 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:56.525766 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:56.525766 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:56.525766 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:38:56.525766 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:38:56.525766 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:38:56.525766 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:38:56.525766 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:38:56.525766 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:38:56.525766 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:38:56.525766 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:38:56.525766 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 135/272] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:38:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 09:38:56.537382 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767606f-1646-444d-886f-112c0d057035 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:56.600154 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:56.769226 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767606f-1646-444d-886f-112c0d057035 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:56.805057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90720ef-5197-4c99-aaa5-ea99035019fa None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:56.805277 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90720ef-5197-4c99-aaa5-ea99035019fa None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:56.805569 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90720ef-5197-4c99-aaa5-ea99035019fa None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:56.808597 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 136/273] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:38:56.813370 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80c399-1590-4990-a8da-bc1e299bedf0 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:56.813731 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80c399-1590-4990-a8da-bc1e299bedf0 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:56.813965 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80c399-1590-4990-a8da-bc1e299bedf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:56.838851 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-9d80c399-1590-4990-a8da-bc1e299bedf0 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:56.840081 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-9d80c399-1590-4990-a8da-bc1e299bedf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:56.852293 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88aef78-5bd7-4dfc-9a0c-f9db61e88291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:56.853799 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88aef78-5bd7-4dfc-9a0c-f9db61e88291 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:56.854559 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88aef78-5bd7-4dfc-9a0c-f9db61e88291 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:56.855333 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88aef78-5bd7-4dfc-9a0c-f9db61e88291 None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:56.857704 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88aef78-5bd7-4dfc-9a0c-f9db61e88291 None admin] RBAC: Adding query filter params (name=member) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:56.858571 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88aef78-5bd7-4dfc-9a0c-f9db61e88291 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:56.861491 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88aef78-5bd7-4dfc-9a0c-f9db61e88291 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:56.881469 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 138/274] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 27 09:38:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:56.887186 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:56.889106 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88aef78-5bd7-4dfc-9a0c-f9db61e88291 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:56.935721 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 137/275] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 09:38:57.059405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:57.087830 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88aef78-5bd7-4dfc-9a0c-f9db61e88291 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:57.152409 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989661f7-2f15-4737-9029-8bcbfb809335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:57.153979 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989661f7-2f15-4737-9029-8bcbfb809335 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:57.154733 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989661f7-2f15-4737-9029-8bcbfb809335 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:57.155599 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989661f7-2f15-4737-9029-8bcbfb809335 None admin] PATH_INFO: `/v3/users/6e86a41118c048ec90c368261697201d` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:57.182195 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989661f7-2f15-4737-9029-8bcbfb809335 None admin] RBAC: Authorizing `identity:get_user(user_id=6e86a41118c048ec90c368261697201d)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:57.185474 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989661f7-2f15-4737-9029-8bcbfb809335 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:57.189637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 139/276] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:38:56 2022] GET /identity/v3/users/6e86a41118c048ec90c368261697201d => generated 293 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:57.196333 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80c399-1590-4990-a8da-bc1e299bedf0 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:57.261299 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57cee3-5e75-4623-acf6-2add94c48b1b None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:57.261299 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57cee3-5e75-4623-acf6-2add94c48b1b None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:57.261299 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57cee3-5e75-4623-acf6-2add94c48b1b None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:57.262958 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 140/277] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:38:57.268450 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fc1b8-c358-42ca-acf1-ce89a2049c0b None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:57.268834 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fc1b8-c358-42ca-acf1-ce89a2049c0b None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:57.268975 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fc1b8-c358-42ca-acf1-ce89a2049c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:57.288468 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-b24fc1b8-c358-42ca-acf1-ce89a2049c0b None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:57.289703 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-b24fc1b8-c358-42ca-acf1-ce89a2049c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:57.353785 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80c399-1590-4990-a8da-bc1e299bedf0 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:57.400766 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0faa52-c7f9-45d8-962e-6ac5434efc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:57.401725 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0faa52-c7f9-45d8-962e-6ac5434efc31 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:57.402180 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0faa52-c7f9-45d8-962e-6ac5434efc31 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:57.402639 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0faa52-c7f9-45d8-962e-6ac5434efc31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:57.403913 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0faa52-c7f9-45d8-962e-6ac5434efc31 None admin] RBAC: Adding query filter params (role.id=378cb7fb6a4e4e5e89ab9a0ecb09d86b, user.id=6e86a41118c048ec90c368261697201d, scope.system=all) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:57.404430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0faa52-c7f9-45d8-962e-6ac5434efc31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:57.407028 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0faa52-c7f9-45d8-962e-6ac5434efc31 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:57.409119 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 141/278] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 09:38:57.411350 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24fc1b8-c358-42ca-acf1-ce89a2049c0b None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:57.419629 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 138/279] 10.222.0.49 () {56 vars in 1308 bytes} [Tue Sep 27 09:38:57 2022] GET /identity/v3/role_assignments?user.id=6e86a41118c048ec90c368261697201d&scope.system=all&role.id=378cb7fb6a4e4e5e89ab9a0ecb09d86b => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:57.560885 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:57.614170 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24fc1b8-c358-42ca-acf1-ce89a2049c0b None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:57.657512 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bab816-88a2-439d-bf0b-b713a02e8213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:57.658604 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bab816-88a2-439d-bf0b-b713a02e8213 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:57.659134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bab816-88a2-439d-bf0b-b713a02e8213 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:57.659603 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bab816-88a2-439d-bf0b-b713a02e8213 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:57.661364 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bab816-88a2-439d-bf0b-b713a02e8213 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:57.663294 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bab816-88a2-439d-bf0b-b713a02e8213 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:57.665311 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 142/280] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:38:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:57.672105 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0faa52-c7f9-45d8-962e-6ac5434efc31 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:57.731164 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:57.872075 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0faa52-c7f9-45d8-962e-6ac5434efc31 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:57.934909 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b1c1b-81ac-40b6-849b-39de1c68f504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:57.935937 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b1c1b-81ac-40b6-849b-39de1c68f504 None admin] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:57.936403 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b1c1b-81ac-40b6-849b-39de1c68f504 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:57.936836 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b1c1b-81ac-40b6-849b-39de1c68f504 None admin] PATH_INFO: `/v3/users` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:57.937980 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b1c1b-81ac-40b6-849b-39de1c68f504 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:57.940716 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b1c1b-81ac-40b6-849b-39de1c68f504 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:57.980008 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 139/281] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 27 09:38:57 2022] POST /identity/v3/users => generated 293 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:38:58.014039 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bab816-88a2-439d-bf0b-b713a02e8213 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:58.225294 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bab816-88a2-439d-bf0b-b713a02e8213 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:58.280906 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8d657-e969-48ac-8790-ee36394fdf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:58.281867 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8d657-e969-48ac-8790-ee36394fdf3b None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:58.282280 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8d657-e969-48ac-8790-ee36394fdf3b None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:58.282681 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8d657-e969-48ac-8790-ee36394fdf3b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:58.299108 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8d657-e969-48ac-8790-ee36394fdf3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:38:58.306702 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-6cd8d657-e969-48ac-8790-ee36394fdf3b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 09:38:58.306702 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:58.306702 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:58.306702 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:58.306702 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:58.306702 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:58.306702 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:58.306702 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:58.306702 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:58.306702 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:58.306702 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:58.306702 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:58.306702 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:38:58.306702 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:38:58.306702 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:38:58.306702 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:38:58.308726 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:38:58.308726 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:38:58.308726 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:38:58.308726 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:38:58.308726 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:58.308726 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:58.308726 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:58.308726 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:58.308726 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:58.308726 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:58.308726 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:58.308726 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:58.308726 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:58.308726 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:58.308726 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:58.308726 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:58.310190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:58.310190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:58.310190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:58.310190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:58.310190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:38:58.310190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:38:58.310190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:38:58.310190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:38:58.310190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:38:58.310190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:38:58.310190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 09:38:58.310190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:38:58.310190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 143/282] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:38:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:38:58.322361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b1c1b-81ac-40b6-849b-39de1c68f504 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:58.451380 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:58.499267 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b1c1b-81ac-40b6-849b-39de1c68f504 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:58.517603 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b750241-649e-495f-957f-7631b345cf29 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:58.518861 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b750241-649e-495f-957f-7631b345cf29 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:58.519915 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b750241-649e-495f-957f-7631b345cf29 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:58.522375 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 144/283] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:38:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:38:58.529480 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3d10e-4f39-4284-99c8-002e016c2970 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:58.530125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3d10e-4f39-4284-99c8-002e016c2970 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:58.530605 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3d10e-4f39-4284-99c8-002e016c2970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:58.538894 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:58.554879 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-70c3d10e-4f39-4284-99c8-002e016c2970 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:38:58.556496 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-70c3d10e-4f39-4284-99c8-002e016c2970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:38:58.561165 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b79112-bad5-4a69-bfda-a0a7e55cfc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:58.562167 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b79112-bad5-4a69-bfda-a0a7e55cfc06 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:58.562624 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b79112-bad5-4a69-bfda-a0a7e55cfc06 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:58.563104 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b79112-bad5-4a69-bfda-a0a7e55cfc06 None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:58.564276 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b79112-bad5-4a69-bfda-a0a7e55cfc06 None admin] RBAC: Adding query filter params (name=reader) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:58.564788 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b79112-bad5-4a69-bfda-a0a7e55cfc06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:58.567538 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b79112-bad5-4a69-bfda-a0a7e55cfc06 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:58.585093 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 140/284] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 27 09:38:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:38:58.603260 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b79112-bad5-4a69-bfda-a0a7e55cfc06 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:58.682280 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 145/285] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:38:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 09:38:58.822469 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b79112-bad5-4a69-bfda-a0a7e55cfc06 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:58.891454 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21406e-9f2e-4ee7-a0d8-96bff3936173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:58.892560 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21406e-9f2e-4ee7-a0d8-96bff3936173 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:58.892994 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21406e-9f2e-4ee7-a0d8-96bff3936173 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:58.893483 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21406e-9f2e-4ee7-a0d8-96bff3936173 None admin] PATH_INFO: `/v3/users/b297e89609a34cd58f1976aed9e98475` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:58.895826 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21406e-9f2e-4ee7-a0d8-96bff3936173 None admin] RBAC: Authorizing `identity:get_user(user_id=b297e89609a34cd58f1976aed9e98475)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:58.898947 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21406e-9f2e-4ee7-a0d8-96bff3936173 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:58.902230 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 141/286] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:38:58 2022] GET /identity/v3/users/b297e89609a34cd58f1976aed9e98475 => generated 297 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:38:58.912122 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3d10e-4f39-4284-99c8-002e016c2970 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:59.101016 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21406e-9f2e-4ee7-a0d8-96bff3936173 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:59.122311 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3d10e-4f39-4284-99c8-002e016c2970 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:59.155185 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:59.171168 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:59.184370 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4ca31-a579-4386-a891-521ffb287b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:59.185042 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4ca31-a579-4386-a891-521ffb287b77 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:59.185324 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4ca31-a579-4386-a891-521ffb287b77 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:59.185597 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4ca31-a579-4386-a891-521ffb287b77 None admin] PATH_INFO: `/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:59.188619 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4ca31-a579-4386-a891-521ffb287b77 None admin] RBAC: Authorizing `identity:get_project(project_id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:59.190221 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4ca31-a579-4386-a891-521ffb287b77 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:59.192180 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 146/287] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:38:58 2022] GET /identity/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:59.216304 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4ca31-a579-4386-a891-521ffb287b77 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:59.330641 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21406e-9f2e-4ee7-a0d8-96bff3936173 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:59.379255 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4ca31-a579-4386-a891-521ffb287b77 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:59.394809 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259f3e0-95a8-4441-bac7-0b5b6c822f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:59.394809 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259f3e0-95a8-4441-bac7-0b5b6c822f6f None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:59.394809 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259f3e0-95a8-4441-bac7-0b5b6c822f6f None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:59.395161 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259f3e0-95a8-4441-bac7-0b5b6c822f6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:59.416185 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4259f3e0-95a8-4441-bac7-0b5b6c822f6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:38:59.424477 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-4259f3e0-95a8-4441-bac7-0b5b6c822f6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:38:59.424477 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:38:59.424477 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:38:59.424477 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:38:59.424477 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:38:59.424477 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:38:59.424477 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:38:59.424477 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:38:59.424477 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:38:59.424477 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:38:59.424477 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:38:59.424477 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:38:59.424477 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:38:59.424477 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:38:59.424477 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:38:59.424477 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:38:59.425430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:38:59.425430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:38:59.425430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:38:59.425430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:38:59.425430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:38:59.425430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:38:59.425430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:38:59.425430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:38:59.425430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:38:59.425430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:38:59.425430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:38:59.425430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:38:59.425430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:38:59.425430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:38:59.425430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:38:59.425430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:38:59.426238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:38:59.426238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:38:59.426238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:38:59.426238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:38:59.426238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:38:59.426238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:38:59.426238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:38:59.426238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:38:59.426238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:38:59.426238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:38:59.426238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:38:59.426238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:38:59.426963 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 142/288] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:38:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:38:59.434276 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259f3e0-95a8-4441-bac7-0b5b6c822f6f None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:59.462349 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb50c0-c7c8-479d-9d19-7e8c4b51e85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:59.463468 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb50c0-c7c8-479d-9d19-7e8c4b51e85f None admin] REQUEST_METHOD: `PUT` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:59.463988 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb50c0-c7c8-479d-9d19-7e8c4b51e85f None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:59.464455 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb50c0-c7c8-479d-9d19-7e8c4b51e85f None admin] PATH_INFO: `/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d/users/b297e89609a34cd58f1976aed9e98475/roles/2b7fd974b36e410db7b0003344b6a5f8` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:59.466693 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb50c0-c7c8-479d-9d19-7e8c4b51e85f None admin] RBAC: Authorizing `identity:create_grant(project_id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d, user_id=b297e89609a34cd58f1976aed9e98475, role_id=2b7fd974b36e410db7b0003344b6a5f8)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:59.468441 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb50c0-c7c8-479d-9d19-7e8c4b51e85f None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:59.514129 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 147/289] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 27 09:38:59 2022] PUT /identity/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d/users/b297e89609a34cd58f1976aed9e98475/roles/2b7fd974b36e410db7b0003344b6a5f8 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 09:38:59.609537 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:59.674438 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259f3e0-95a8-4441-bac7-0b5b6c822f6f None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:59.747050 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab960f-2b73-49d1-8253-183d0ad7a4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:59.748087 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab960f-2b73-49d1-8253-183d0ad7a4c4 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:59.748564 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab960f-2b73-49d1-8253-183d0ad7a4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:38:59.749027 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab960f-2b73-49d1-8253-183d0ad7a4c4 None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:38:59.750163 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab960f-2b73-49d1-8253-183d0ad7a4c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:38:59.750678 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab960f-2b73-49d1-8253-183d0ad7a4c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:38:59.753192 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab960f-2b73-49d1-8253-183d0ad7a4c4 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:38:59.770524 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 143/290] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 27 09:38:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:38:59.781409 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb50c0-c7c8-479d-9d19-7e8c4b51e85f None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:38:59.880074 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:38:59.951856 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb50c0-c7c8-479d-9d19-7e8c4b51e85f None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:38:59.999014 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5047b-4409-48f8-b47f-bfbd1848357c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:38:59.999684 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5047b-4409-48f8-b47f-bfbd1848357c None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:38:59.999965 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5047b-4409-48f8-b47f-bfbd1848357c None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:00.000240 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5047b-4409-48f8-b47f-bfbd1848357c None admin] PATH_INFO: `/v3/users/e1e5e4ffefae4cde9b15505952ca0644` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:00.002207 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5047b-4409-48f8-b47f-bfbd1848357c None admin] RBAC: Authorizing `identity:get_user(user_id=e1e5e4ffefae4cde9b15505952ca0644)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:00.003749 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5047b-4409-48f8-b47f-bfbd1848357c None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:00.005909 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 148/291] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:38:59 2022] GET /identity/v3/users/e1e5e4ffefae4cde9b15505952ca0644 => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:39:00.016604 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab960f-2b73-49d1-8253-183d0ad7a4c4 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:00.216639 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab960f-2b73-49d1-8253-183d0ad7a4c4 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:00.263426 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:00.269538 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37893d-d46e-4736-bb49-e18dd7c75ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:00.270229 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37893d-d46e-4736-bb49-e18dd7c75ee2 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:00.270508 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37893d-d46e-4736-bb49-e18dd7c75ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:00.270798 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37893d-d46e-4736-bb49-e18dd7c75ee2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:00.365613 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37893d-d46e-4736-bb49-e18dd7c75ee2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:00.367422 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37893d-d46e-4736-bb49-e18dd7c75ee2 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:00.525386 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 144/292] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:39:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:39:00.530936 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5047b-4409-48f8-b47f-bfbd1848357c None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:00.681801 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5047b-4409-48f8-b47f-bfbd1848357c None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:00.718441 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:00.731711 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ca8a9-1727-4b33-9281-fa7466651797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:00.732372 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ca8a9-1727-4b33-9281-fa7466651797 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:00.732647 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ca8a9-1727-4b33-9281-fa7466651797 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:00.732916 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ca8a9-1727-4b33-9281-fa7466651797 None admin] PATH_INFO: `/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:00.734092 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ca8a9-1727-4b33-9281-fa7466651797 None admin] RBAC: Authorizing `identity:get_project(project_id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:00.735601 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ca8a9-1727-4b33-9281-fa7466651797 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:00.737599 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 149/293] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:39:00 2022] GET /identity/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:00.744248 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37893d-d46e-4736-bb49-e18dd7c75ee2 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:00.786138 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:00.879536 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37893d-d46e-4736-bb49-e18dd7c75ee2 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:00.920227 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687bdf5-050e-4f95-bcb9-973bcd432b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:00.920922 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687bdf5-050e-4f95-bcb9-973bcd432b55 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:00.922826 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df761844-d30c-4f30-b02f-ce3718aea6fa None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:00.923109 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df761844-d30c-4f30-b02f-ce3718aea6fa None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:00.923375 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df761844-d30c-4f30-b02f-ce3718aea6fa None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:00.925056 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 150/294] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:00.925298 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687bdf5-050e-4f95-bcb9-973bcd432b55 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:00.925605 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687bdf5-050e-4f95-bcb9-973bcd432b55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:00.926432 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687bdf5-050e-4f95-bcb9-973bcd432b55 None admin] RBAC: Adding query filter params (role.id=378cb7fb6a4e4e5e89ab9a0ecb09d86b, scope.project.id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d, user.id=e1e5e4ffefae4cde9b15505952ca0644) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:00.926739 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687bdf5-050e-4f95-bcb9-973bcd432b55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:00.928863 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687bdf5-050e-4f95-bcb9-973bcd432b55 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:00.936593 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8384f93-8ebe-4526-b9c0-69c2cbc0cca6 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:00.936901 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8384f93-8ebe-4526-b9c0-69c2cbc0cca6 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:00.937136 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8384f93-8ebe-4526-b9c0-69c2cbc0cca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:00.946493 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 145/295] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:39:00 2022] GET /identity/v3/role_assignments?user.id=e1e5e4ffefae4cde9b15505952ca0644&scope.project.id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d&role.id=378cb7fb6a4e4e5e89ab9a0ecb09d86b => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:00.960174 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-e8384f93-8ebe-4526-b9c0-69c2cbc0cca6 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:00.961494 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-e8384f93-8ebe-4526-b9c0-69c2cbc0cca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:01.076455 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 151/296] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:39:01.500020 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687bdf5-050e-4f95-bcb9-973bcd432b55 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:01.609842 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98aff9-98d9-4bd3-b6cb-dcf1f614c95d None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:01.610632 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98aff9-98d9-4bd3-b6cb-dcf1f614c95d None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:01.610632 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98aff9-98d9-4bd3-b6cb-dcf1f614c95d None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:01.612147 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 152/297] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:39:01.621055 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905e6f1-1b48-4305-9092-2a65f29dc6dd None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:01.621340 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905e6f1-1b48-4305-9092-2a65f29dc6dd None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:01.621595 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905e6f1-1b48-4305-9092-2a65f29dc6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:01.629943 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:01.637193 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687bdf5-050e-4f95-bcb9-973bcd432b55 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:01.654017 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-f905e6f1-1b48-4305-9092-2a65f29dc6dd None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:01.655282 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-f905e6f1-1b48-4305-9092-2a65f29dc6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:01.683838 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dc1c6-d944-4d31-ad11-17aedd030763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:01.684504 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dc1c6-d944-4d31-ad11-17aedd030763 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:01.684784 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dc1c6-d944-4d31-ad11-17aedd030763 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:01.685116 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dc1c6-d944-4d31-ad11-17aedd030763 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:01.702110 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82dc1c6-d944-4d31-ad11-17aedd030763 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:01.708316 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-b82dc1c6-d944-4d31-ad11-17aedd030763 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:39:01.708316 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:01.708316 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:01.708316 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:01.708316 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:01.708316 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:01.708316 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:01.708316 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:01.708316 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:01.708316 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:01.708316 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:01.708316 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:01.708316 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:01.708316 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:01.708316 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:01.708316 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:01.709364 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:01.709364 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:01.709364 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:01.709364 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:01.709364 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:01.709364 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:01.709364 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:01.709364 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:01.709364 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:01.709364 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:01.709364 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:01.709364 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:01.709364 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:01.709364 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:01.709364 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:01.709364 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:01.710143 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:01.710143 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:01.710143 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:01.710143 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:01.710143 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:01.710143 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:01.710143 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:01.710143 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:01.710143 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:01.710143 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:01.710143 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:39:01.710143 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:01.710728 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 146/298] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:39:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:01.720102 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dc1c6-d944-4d31-ad11-17aedd030763 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:01.775811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 153/299] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:39:01.788670 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68ff29-1ecf-49fe-92bf-c06a464ce92a None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:01.789142 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68ff29-1ecf-49fe-92bf-c06a464ce92a None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:01.789597 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68ff29-1ecf-49fe-92bf-c06a464ce92a None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:01.794942 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 154/300] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:39:01.800102 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dab5aa-2d29-4e30-a0c0-43a560b980d9 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:01.800376 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dab5aa-2d29-4e30-a0c0-43a560b980d9 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:01.800683 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dab5aa-2d29-4e30-a0c0-43a560b980d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:01.821710 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-95dab5aa-2d29-4e30-a0c0-43a560b980d9 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:01.821952 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-95dab5aa-2d29-4e30-a0c0-43a560b980d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:01.876280 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dc1c6-d944-4d31-ad11-17aedd030763 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:01.881697 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:01.902371 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 155/301] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 09:39:01.939090 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106335a4-2d77-42f3-8541-136f0a3c3386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:01.940153 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106335a4-2d77-42f3-8541-136f0a3c3386 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:01.940628 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106335a4-2d77-42f3-8541-136f0a3c3386 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:01.941094 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106335a4-2d77-42f3-8541-136f0a3c3386 None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:01.942078 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106335a4-2d77-42f3-8541-136f0a3c3386 None admin] RBAC: Adding query filter params (name=member) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:01.942580 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106335a4-2d77-42f3-8541-136f0a3c3386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:01.944554 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106335a4-2d77-42f3-8541-136f0a3c3386 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:01.954751 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 147/302] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 27 09:39:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:39:01.961182 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dab5aa-2d29-4e30-a0c0-43a560b980d9 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:02.077315 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dab5aa-2d29-4e30-a0c0-43a560b980d9 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:02.119893 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51becb4d-e71c-4460-8c43-b099e86657d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:02.120553 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51becb4d-e71c-4460-8c43-b099e86657d7 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:02.120830 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51becb4d-e71c-4460-8c43-b099e86657d7 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:02.121101 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51becb4d-e71c-4460-8c43-b099e86657d7 None admin] PATH_INFO: `/v3/users/6e86a41118c048ec90c368261697201d` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:02.122326 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51becb4d-e71c-4460-8c43-b099e86657d7 None admin] RBAC: Authorizing `identity:get_user(user_id=6e86a41118c048ec90c368261697201d)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:02.123836 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51becb4d-e71c-4460-8c43-b099e86657d7 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:02.125477 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 156/303] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:39:01 2022] GET /identity/v3/users/6e86a41118c048ec90c368261697201d => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:39:02.131202 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106335a4-2d77-42f3-8541-136f0a3c3386 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:02.131723 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51becb4d-e71c-4460-8c43-b099e86657d7 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:02.161126 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:02.208865 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:02.258424 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51becb4d-e71c-4460-8c43-b099e86657d7 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:02.297076 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c881cd-e6c5-4693-88eb-f8e032df5269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:02.297755 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c881cd-e6c5-4693-88eb-f8e032df5269 None admin] REQUEST_METHOD: `PUT` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:02.298042 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c881cd-e6c5-4693-88eb-f8e032df5269 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:02.298288 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c881cd-e6c5-4693-88eb-f8e032df5269 None admin] PATH_INFO: `/v3/system/users/6e86a41118c048ec90c368261697201d/roles/378cb7fb6a4e4e5e89ab9a0ecb09d86b` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:02.299820 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c881cd-e6c5-4693-88eb-f8e032df5269 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6e86a41118c048ec90c368261697201d, role_id=378cb7fb6a4e4e5e89ab9a0ecb09d86b)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:02.301322 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c881cd-e6c5-4693-88eb-f8e032df5269 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:02.315268 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 157/304] 10.222.0.49 () {58 vars in 1334 bytes} [Tue Sep 27 09:39:02 2022] PUT /identity/v3/system/users/6e86a41118c048ec90c368261697201d/roles/378cb7fb6a4e4e5e89ab9a0ecb09d86b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 09:39:02.331738 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106335a4-2d77-42f3-8541-136f0a3c3386 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:02.361066 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c881cd-e6c5-4693-88eb-f8e032df5269 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:02.407895 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036d5ed-59da-404a-bd86-d61f3a8f340b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:02.408991 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036d5ed-59da-404a-bd86-d61f3a8f340b None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:02.409426 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036d5ed-59da-404a-bd86-d61f3a8f340b None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:02.409984 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036d5ed-59da-404a-bd86-d61f3a8f340b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:02.430588 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036d5ed-59da-404a-bd86-d61f3a8f340b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:02.441478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-d036d5ed-59da-404a-bd86-d61f3a8f340b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 09:39:02.441478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:02.441478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:02.441478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:02.441478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:02.441478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:02.441478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:02.441478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:02.441478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:02.441478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:02.441478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:02.441478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:02.441478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:02.441478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:02.441478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:02.441478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:02.444669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:02.444669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:02.444669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:02.444669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:02.444669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:02.444669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:02.444669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:02.444669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:02.444669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:02.444669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:02.444669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:02.444669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:02.444669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:02.444669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:02.444669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:02.444669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:02.445572 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:02.445572 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:02.445572 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:02.445572 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:02.445572 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:02.445572 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:02.445572 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:02.445572 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:02.445572 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:02.445572 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:02.445572 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 09:39:02.445572 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:02.445572 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 148/305] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:39:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 09:39:02.456543 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036d5ed-59da-404a-bd86-d61f3a8f340b None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:02.592735 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c881cd-e6c5-4693-88eb-f8e032df5269 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:02.627507 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:02.632108 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:02.658861 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ee7e4-a28d-43af-b473-e69b051201d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:02.659552 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ee7e4-a28d-43af-b473-e69b051201d2 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:02.659876 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ee7e4-a28d-43af-b473-e69b051201d2 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:02.660161 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ee7e4-a28d-43af-b473-e69b051201d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:02.661851 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ee7e4-a28d-43af-b473-e69b051201d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:02.663804 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ee7e4-a28d-43af-b473-e69b051201d2 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:02.666232 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 158/306] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:39:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:39:02.674431 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ee7e4-a28d-43af-b473-e69b051201d2 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:02.679940 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036d5ed-59da-404a-bd86-d61f3a8f340b None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:02.740874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca269c-37cb-4eea-a026-ac904a94ae2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:02.742579 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca269c-37cb-4eea-a026-ac904a94ae2c None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:02.743422 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca269c-37cb-4eea-a026-ac904a94ae2c None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:02.744229 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca269c-37cb-4eea-a026-ac904a94ae2c None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:02.746030 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca269c-37cb-4eea-a026-ac904a94ae2c None admin] RBAC: Adding query filter params (name=reader) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:02.746868 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca269c-37cb-4eea-a026-ac904a94ae2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:02.749824 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca269c-37cb-4eea-a026-ac904a94ae2c None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:02.773533 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 149/307] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 27 09:39:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:02.785155 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca269c-37cb-4eea-a026-ac904a94ae2c None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:02.812515 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ee7e4-a28d-43af-b473-e69b051201d2 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:02.859876 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb90b5-313e-4351-90a0-668393a6e727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:02.860676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb90b5-313e-4351-90a0-668393a6e727 None admin] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:02.861168 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb90b5-313e-4351-90a0-668393a6e727 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:02.861480 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb90b5-313e-4351-90a0-668393a6e727 None admin] PATH_INFO: `/v3/groups` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:02.862479 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb90b5-313e-4351-90a0-668393a6e727 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:02.864897 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb90b5-313e-4351-90a0-668393a6e727 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:02.891652 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 159/308] 10.222.0.49 () {60 vars in 1134 bytes} [Tue Sep 27 09:39:02 2022] POST /identity/v3/groups => generated 229 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 09:39:02.977870 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca269c-37cb-4eea-a026-ac904a94ae2c None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:03.030691 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384a0a3-fb47-4b22-8876-3eaea0e4f329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:03.031812 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384a0a3-fb47-4b22-8876-3eaea0e4f329 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:03.032339 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384a0a3-fb47-4b22-8876-3eaea0e4f329 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:03.032875 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384a0a3-fb47-4b22-8876-3eaea0e4f329 None admin] PATH_INFO: `/v3/users/5fb9fb359fa345679dd44f68ce56b423` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:03.046790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:03.052330 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384a0a3-fb47-4b22-8876-3eaea0e4f329 None admin] RBAC: Authorizing `identity:get_user(user_id=5fb9fb359fa345679dd44f68ce56b423)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:03.054329 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384a0a3-fb47-4b22-8876-3eaea0e4f329 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:03.056809 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 150/309] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:39:02 2022] GET /identity/v3/users/5fb9fb359fa345679dd44f68ce56b423 => generated 293 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:03.063614 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb90b5-313e-4351-90a0-668393a6e727 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:03.131649 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:03.202244 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb90b5-313e-4351-90a0-668393a6e727 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:03.248676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213545da-e652-4428-a767-885eeec7f5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:03.249334 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213545da-e652-4428-a767-885eeec7f5b5 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:03.249625 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213545da-e652-4428-a767-885eeec7f5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:03.249889 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213545da-e652-4428-a767-885eeec7f5b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:03.250651 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213545da-e652-4428-a767-885eeec7f5b5 None admin] RBAC: Adding query filter params (role.id=2b7fd974b36e410db7b0003344b6a5f8, user.id=5fb9fb359fa345679dd44f68ce56b423, scope.system=all) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:03.251045 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213545da-e652-4428-a767-885eeec7f5b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:03.252687 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213545da-e652-4428-a767-885eeec7f5b5 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:03.260338 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 160/310] 10.222.0.49 () {56 vars in 1308 bytes} [Tue Sep 27 09:39:03 2022] GET /identity/v3/role_assignments?user.id=5fb9fb359fa345679dd44f68ce56b423&scope.system=all&role.id=2b7fd974b36e410db7b0003344b6a5f8 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:03.378143 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbc3e5-ab97-4aff-9cb0-ce40a7d5d7a6 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:03.378630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbc3e5-ab97-4aff-9cb0-ce40a7d5d7a6 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:03.379137 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbc3e5-ab97-4aff-9cb0-ce40a7d5d7a6 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:03.382206 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 151/311] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:39:03.391846 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fa96b-3fcf-4a08-aa57-1c55ab1fbc2a None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:03.392321 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fa96b-3fcf-4a08-aa57-1c55ab1fbc2a None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:03.392795 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fa96b-3fcf-4a08-aa57-1c55ab1fbc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:03.424088 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-090fa96b-3fcf-4a08-aa57-1c55ab1fbc2a None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:03.425804 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-090fa96b-3fcf-4a08-aa57-1c55ab1fbc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:03.533047 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 161/312] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:39:03.862342 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbc3e5-ab97-4aff-9cb0-ce40a7d5d7a6 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:03.993698 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbc3e5-ab97-4aff-9cb0-ce40a7d5d7a6 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:04.036709 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7a36d-1df7-4ecb-ab95-06bad4fb6df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:04.037784 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7a36d-1df7-4ecb-ab95-06bad4fb6df7 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:04.038269 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7a36d-1df7-4ecb-ab95-06bad4fb6df7 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:04.038789 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7a36d-1df7-4ecb-ab95-06bad4fb6df7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:04.051254 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7a36d-1df7-4ecb-ab95-06bad4fb6df7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:04.056948 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-1ae7a36d-1df7-4ecb-ab95-06bad4fb6df7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 09:39:04.056948 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:04.056948 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:04.056948 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:04.056948 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:04.056948 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:04.056948 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:04.056948 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:04.056948 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:04.056948 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:04.056948 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:04.056948 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:04.056948 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:04.056948 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:04.056948 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:04.056948 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:04.057897 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:04.057897 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:04.057897 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:04.057897 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:04.057897 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:04.057897 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:04.057897 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:04.057897 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:04.057897 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:04.057897 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:04.057897 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:04.057897 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:04.057897 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:04.057897 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:04.057897 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:04.057897 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:04.058680 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:04.058680 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:04.058680 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:04.058680 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:04.058680 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:04.058680 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:04.058680 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:04.058680 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:04.058680 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:04.058680 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:04.058680 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 09:39:04.058680 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:04.060973 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 152/313] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:39:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:04.067208 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fa96b-3fcf-4a08-aa57-1c55ab1fbc2a None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:04.113397 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:04.180827 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fa96b-3fcf-4a08-aa57-1c55ab1fbc2a None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:04.217706 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9c684-cc51-4bbc-a5ae-a0a77cb3ff06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:04.218333 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9c684-cc51-4bbc-a5ae-a0a77cb3ff06 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:04.218613 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9c684-cc51-4bbc-a5ae-a0a77cb3ff06 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:04.218914 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9c684-cc51-4bbc-a5ae-a0a77cb3ff06 None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:04.219692 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9c684-cc51-4bbc-a5ae-a0a77cb3ff06 None admin] RBAC: Adding query filter params (name=reader) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:04.219998 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9c684-cc51-4bbc-a5ae-a0a77cb3ff06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:04.221444 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9c684-cc51-4bbc-a5ae-a0a77cb3ff06 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:04.232102 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 162/314] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 27 09:39:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:04.237978 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7a36d-1df7-4ecb-ab95-06bad4fb6df7 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:04.304146 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:04.351371 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7a36d-1df7-4ecb-ab95-06bad4fb6df7 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:04.390037 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1fad6-ba41-41e9-bbd3-1976d2c802ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:04.390607 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1fad6-ba41-41e9-bbd3-1976d2c802ca None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:04.390919 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1fad6-ba41-41e9-bbd3-1976d2c802ca None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:04.391185 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1fad6-ba41-41e9-bbd3-1976d2c802ca None admin] PATH_INFO: `/v3/users/b297e89609a34cd58f1976aed9e98475` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:04.392385 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1fad6-ba41-41e9-bbd3-1976d2c802ca None admin] RBAC: Authorizing `identity:get_user(user_id=b297e89609a34cd58f1976aed9e98475)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:04.393890 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1fad6-ba41-41e9-bbd3-1976d2c802ca None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:04.395923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 153/315] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:39:04 2022] GET /identity/v3/users/b297e89609a34cd58f1976aed9e98475 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:04.401710 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9c684-cc51-4bbc-a5ae-a0a77cb3ff06 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:04.571682 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9c684-cc51-4bbc-a5ae-a0a77cb3ff06 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:04.587425 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:04.643102 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b7c86-08ff-47be-9667-e4c71c0f8a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:04.644054 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b7c86-08ff-47be-9667-e4c71c0f8a02 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:04.644515 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b7c86-08ff-47be-9667-e4c71c0f8a02 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:04.644994 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b7c86-08ff-47be-9667-e4c71c0f8a02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:04.771844 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b7c86-08ff-47be-9667-e4c71c0f8a02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:04.774086 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b7c86-08ff-47be-9667-e4c71c0f8a02 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:04.968665 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 163/316] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:39:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:39:04.976241 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1fad6-ba41-41e9-bbd3-1976d2c802ca None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:05.091020 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1fad6-ba41-41e9-bbd3-1976d2c802ca None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:05.120419 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:05.129446 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d62436-e1b4-4e22-955e-a5ee791410ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:05.130104 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d62436-e1b4-4e22-955e-a5ee791410ea None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:05.130678 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d62436-e1b4-4e22-955e-a5ee791410ea None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:05.131324 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d62436-e1b4-4e22-955e-a5ee791410ea None admin] PATH_INFO: `/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:05.132513 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d62436-e1b4-4e22-955e-a5ee791410ea None admin] RBAC: Authorizing `identity:get_project(project_id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:05.134306 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d62436-e1b4-4e22-955e-a5ee791410ea None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:05.136420 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 154/317] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:39:04 2022] GET /identity/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:05.143961 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b7c86-08ff-47be-9667-e4c71c0f8a02 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:05.146454 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:05.332813 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b7c86-08ff-47be-9667-e4c71c0f8a02 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:05.400806 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b4dab-a256-4a38-bc15-cb8d3065658e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:05.401836 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b4dab-a256-4a38-bc15-cb8d3065658e None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:05.402325 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b4dab-a256-4a38-bc15-cb8d3065658e None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:05.402815 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b4dab-a256-4a38-bc15-cb8d3065658e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:05.404132 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b4dab-a256-4a38-bc15-cb8d3065658e None admin] RBAC: Adding query filter params (role.id=2b7fd974b36e410db7b0003344b6a5f8, scope.project.id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d, user.id=b297e89609a34cd58f1976aed9e98475) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:05.404675 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b4dab-a256-4a38-bc15-cb8d3065658e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:05.407421 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b4dab-a256-4a38-bc15-cb8d3065658e None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:05.420251 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 164/318] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:39:05 2022] GET /identity/v3/role_assignments?user.id=b297e89609a34cd58f1976aed9e98475&scope.project.id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d&role.id=2b7fd974b36e410db7b0003344b6a5f8 => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:05.630846 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6e148-23e2-4625-9a49-2cb9d757f637 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:05.631319 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6e148-23e2-4625-9a49-2cb9d757f637 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:05.631807 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6e148-23e2-4625-9a49-2cb9d757f637 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:05.634661 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 155/319] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:05.640466 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119ef9c-3de9-4ba5-8317-9220a2d59233 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:05.641097 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119ef9c-3de9-4ba5-8317-9220a2d59233 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:05.641593 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119ef9c-3de9-4ba5-8317-9220a2d59233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:05.674535 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-c119ef9c-3de9-4ba5-8317-9220a2d59233 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:05.676562 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-c119ef9c-3de9-4ba5-8317-9220a2d59233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:05.768940 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6772277-6b7b-4af3-883f-560285089474 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:05.769890 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6772277-6b7b-4af3-883f-560285089474 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:05.770337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6772277-6b7b-4af3-883f-560285089474 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:05.775378 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 156/320] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:05.784435 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd757b2-a394-48b9-a8b5-fed313ce1b48 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:05.785088 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd757b2-a394-48b9-a8b5-fed313ce1b48 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:05.785556 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd757b2-a394-48b9-a8b5-fed313ce1b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:05.788681 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:05.811428 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 165/321] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:39:05.818746 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-2fd757b2-a394-48b9-a8b5-fed313ce1b48 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:05.820916 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-2fd757b2-a394-48b9-a8b5-fed313ce1b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:05.937561 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 157/322] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 09:39:06.353491 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119ef9c-3de9-4ba5-8317-9220a2d59233 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:06.360089 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd757b2-a394-48b9-a8b5-fed313ce1b48 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:06.512201 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119ef9c-3de9-4ba5-8317-9220a2d59233 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:06.538214 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd757b2-a394-48b9-a8b5-fed313ce1b48 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:06.552922 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432589e2-6cd8-4922-b52a-7d4d94a78bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:06.553704 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432589e2-6cd8-4922-b52a-7d4d94a78bf5 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:06.554067 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432589e2-6cd8-4922-b52a-7d4d94a78bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:06.554427 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432589e2-6cd8-4922-b52a-7d4d94a78bf5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:06.556009 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432589e2-6cd8-4922-b52a-7d4d94a78bf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:06.557653 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432589e2-6cd8-4922-b52a-7d4d94a78bf5 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:06.559478 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 166/323] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:39:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:06.560635 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f519ce2-30bc-4293-a769-15fa47295ed0 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:06.560907 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f519ce2-30bc-4293-a769-15fa47295ed0 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:06.561389 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f519ce2-30bc-4293-a769-15fa47295ed0 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:06.562831 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 167/324] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:06.568591 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f519ce2-30bc-4293-a769-15fa47295ed0 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:06.584378 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:06.603653 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b0c23-cc44-4504-b6b5-e20c3ddef879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:06.604467 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b0c23-cc44-4504-b6b5-e20c3ddef879 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:06.604921 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b0c23-cc44-4504-b6b5-e20c3ddef879 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:06.605347 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b0c23-cc44-4504-b6b5-e20c3ddef879 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:06.621524 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b0c23-cc44-4504-b6b5-e20c3ddef879 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:06.626869 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-591b0c23-cc44-4504-b6b5-e20c3ddef879 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:39:06.626869 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:06.626869 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:06.626869 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:06.626869 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:06.626869 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:06.626869 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:06.626869 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:06.626869 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:06.626869 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:06.626869 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:06.626869 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:06.626869 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:06.626869 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:06.626869 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:06.626869 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:06.628834 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:06.628834 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:06.628834 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:06.628834 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:06.628834 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:06.628834 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:06.628834 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:06.628834 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:06.628834 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:06.628834 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:06.628834 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:06.628834 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:06.628834 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:06.628834 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:06.628834 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:06.628834 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:06.630226 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:06.630226 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:06.630226 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:06.630226 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:06.630226 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:06.630226 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:06.630226 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:06.630226 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:06.630226 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:06.630226 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:06.630226 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:39:06.630226 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:06.630226 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 158/325] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:39:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 09:39:06.632132 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ad080-e4f1-490c-bb64-e5846db33e8b None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:06.632132 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ad080-e4f1-490c-bb64-e5846db33e8b None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:06.632132 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ad080-e4f1-490c-bb64-e5846db33e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:06.655494 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-bc1ad080-e4f1-490c-bb64-e5846db33e8b None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:06.656918 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-bc1ad080-e4f1-490c-bb64-e5846db33e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:06.661248 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:06.714667 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f519ce2-30bc-4293-a769-15fa47295ed0 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:06.751292 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852ca55-c6dd-4577-baf7-f4495d0f4b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:06.751933 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852ca55-c6dd-4577-baf7-f4495d0f4b41 None admin] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:06.752212 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852ca55-c6dd-4577-baf7-f4495d0f4b41 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:06.752484 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852ca55-c6dd-4577-baf7-f4495d0f4b41 None admin] PATH_INFO: `/v3/groups` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:06.753127 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852ca55-c6dd-4577-baf7-f4495d0f4b41 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:06.754611 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852ca55-c6dd-4577-baf7-f4495d0f4b41 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:06.761748 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 159/326] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:39:06.763545 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ad080-e4f1-490c-bb64-e5846db33e8b None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:06.782839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 168/327] 10.222.0.49 () {60 vars in 1134 bytes} [Tue Sep 27 09:39:06 2022] POST /identity/v3/groups => generated 226 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 09:39:06.971547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ad080-e4f1-490c-bb64-e5846db33e8b None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:07.000233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:07.041574 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7319d-ed8a-4b47-834a-53bb147d67df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:07.042664 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7319d-ed8a-4b47-834a-53bb147d67df None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:07.043185 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7319d-ed8a-4b47-834a-53bb147d67df None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:07.043670 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7319d-ed8a-4b47-834a-53bb147d67df None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:07.044916 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7319d-ed8a-4b47-834a-53bb147d67df None admin] RBAC: Adding query filter params (name=member) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:07.045446 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7319d-ed8a-4b47-834a-53bb147d67df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:07.048092 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7319d-ed8a-4b47-834a-53bb147d67df None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:07.065063 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 160/328] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 27 09:39:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:07.075252 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852ca55-c6dd-4577-baf7-f4495d0f4b41 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:07.249663 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852ca55-c6dd-4577-baf7-f4495d0f4b41 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:07.263813 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7319d-ed8a-4b47-834a-53bb147d67df None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:07.299846 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:07.323016 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed996a5-2741-4e7a-800b-2944753074e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:07.324868 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed996a5-2741-4e7a-800b-2944753074e3 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:07.325327 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed996a5-2741-4e7a-800b-2944753074e3 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:07.325783 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed996a5-2741-4e7a-800b-2944753074e3 None admin] PATH_INFO: `/v3/users/6e86a41118c048ec90c368261697201d` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:07.330574 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed996a5-2741-4e7a-800b-2944753074e3 None admin] RBAC: Authorizing `identity:get_user(user_id=6e86a41118c048ec90c368261697201d)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:07.332148 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed996a5-2741-4e7a-800b-2944753074e3 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:07.335272 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 169/329] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:39:07 2022] GET /identity/v3/users/6e86a41118c048ec90c368261697201d => generated 293 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:07.345756 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed996a5-2741-4e7a-800b-2944753074e3 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:07.443810 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7319d-ed8a-4b47-834a-53bb147d67df None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:07.484112 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8ae8f-3c63-4b82-95c8-8138499be871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:07.485265 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8ae8f-3c63-4b82-95c8-8138499be871 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:07.485732 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8ae8f-3c63-4b82-95c8-8138499be871 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:07.486208 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8ae8f-3c63-4b82-95c8-8138499be871 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:07.499357 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8ae8f-3c63-4b82-95c8-8138499be871 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:07.507018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-09a8ae8f-3c63-4b82-95c8-8138499be871 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 09:39:07.507018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:07.507018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:07.507018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:07.507018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:07.507018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:07.507018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:07.507018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:07.507018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:07.507018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:07.507018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:07.507018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:07.507018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:07.507018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:07.507018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:07.507018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:07.507974 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:07.507974 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:07.507974 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:07.507974 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:07.507974 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:07.507974 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:07.507974 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:07.507974 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:07.507974 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:07.507974 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:07.507974 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:07.507974 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:07.507974 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:07.507974 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:07.507974 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:07.507974 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:07.508739 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:07.508739 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:07.508739 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:07.508739 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:07.508739 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:07.508739 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:07.508739 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:07.508739 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:07.508739 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:07.508739 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:07.508739 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 09:39:07.508739 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:07.513630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 161/330] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:39:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 09:39:07.516547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8ae8f-3c63-4b82-95c8-8138499be871 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:07.533038 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed996a5-2741-4e7a-800b-2944753074e3 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:07.570706 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:07.603725 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9a21f-b222-45bc-a1c5-469bad6f73bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:07.605127 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9a21f-b222-45bc-a1c5-469bad6f73bc None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:07.605811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9a21f-b222-45bc-a1c5-469bad6f73bc None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:07.606476 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9a21f-b222-45bc-a1c5-469bad6f73bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:07.608077 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9a21f-b222-45bc-a1c5-469bad6f73bc None admin] RBAC: Adding query filter params (role.id=378cb7fb6a4e4e5e89ab9a0ecb09d86b, user.id=6e86a41118c048ec90c368261697201d, scope.system=all) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:07.608820 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9a21f-b222-45bc-a1c5-469bad6f73bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:07.611797 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9a21f-b222-45bc-a1c5-469bad6f73bc None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:07.642955 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 170/331] 10.222.0.49 () {56 vars in 1308 bytes} [Tue Sep 27 09:39:07 2022] GET /identity/v3/role_assignments?user.id=6e86a41118c048ec90c368261697201d&scope.system=all&role.id=378cb7fb6a4e4e5e89ab9a0ecb09d86b => generated 510 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:39:07.648672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8ae8f-3c63-4b82-95c8-8138499be871 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:07.690565 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c796d6-4cee-4f87-8992-e12134940d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:07.691241 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c796d6-4cee-4f87-8992-e12134940d58 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:07.691512 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c796d6-4cee-4f87-8992-e12134940d58 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:07.691777 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c796d6-4cee-4f87-8992-e12134940d58 None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:07.692451 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c796d6-4cee-4f87-8992-e12134940d58 None admin] RBAC: Adding query filter params (name=reader) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:07.692727 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c796d6-4cee-4f87-8992-e12134940d58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:07.694413 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c796d6-4cee-4f87-8992-e12134940d58 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:07.708000 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 162/332] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 27 09:39:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:39:07.717012 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9a21f-b222-45bc-a1c5-469bad6f73bc None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:07.816816 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:07.946522 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9a21f-b222-45bc-a1c5-469bad6f73bc None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:08.027265 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3a67b-c13e-4f6d-a4d0-62ee48d43a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:08.028365 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3a67b-c13e-4f6d-a4d0-62ee48d43a37 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:08.028846 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3a67b-c13e-4f6d-a4d0-62ee48d43a37 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:08.029411 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3a67b-c13e-4f6d-a4d0-62ee48d43a37 None admin] PATH_INFO: `/v3/users/5fb9fb359fa345679dd44f68ce56b423` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:08.031761 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3a67b-c13e-4f6d-a4d0-62ee48d43a37 None admin] RBAC: Authorizing `identity:get_user(user_id=5fb9fb359fa345679dd44f68ce56b423)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:08.034453 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3a67b-c13e-4f6d-a4d0-62ee48d43a37 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:08.037935 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 171/333] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:39:07 2022] GET /identity/v3/users/5fb9fb359fa345679dd44f68ce56b423 => generated 293 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:08.047568 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c796d6-4cee-4f87-8992-e12134940d58 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:08.274120 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:08.282256 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c796d6-4cee-4f87-8992-e12134940d58 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:08.343268 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27276c3a-8449-48ed-a2ce-1ea3c22e1a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:08.344316 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27276c3a-8449-48ed-a2ce-1ea3c22e1a74 None admin] REQUEST_METHOD: `PUT` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:08.344786 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27276c3a-8449-48ed-a2ce-1ea3c22e1a74 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:08.345243 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27276c3a-8449-48ed-a2ce-1ea3c22e1a74 None admin] PATH_INFO: `/v3/system/users/5fb9fb359fa345679dd44f68ce56b423/roles/2b7fd974b36e410db7b0003344b6a5f8` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:08.347026 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27276c3a-8449-48ed-a2ce-1ea3c22e1a74 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5fb9fb359fa345679dd44f68ce56b423, role_id=2b7fd974b36e410db7b0003344b6a5f8)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:08.348627 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27276c3a-8449-48ed-a2ce-1ea3c22e1a74 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:08.361093 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 163/334] 10.222.0.49 () {58 vars in 1334 bytes} [Tue Sep 27 09:39:08 2022] PUT /identity/v3/system/users/5fb9fb359fa345679dd44f68ce56b423/roles/2b7fd974b36e410db7b0003344b6a5f8 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 09:39:11.157801 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca0e97-256e-4958-b88c-6d6ea22236c1 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:11.158892 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca0e97-256e-4958-b88c-6d6ea22236c1 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:11.159461 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca0e97-256e-4958-b88c-6d6ea22236c1 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:11.161866 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 172/335] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:11.169212 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb0d49-d1da-4352-a40f-09009d7de3e5 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:11.170255 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb0d49-d1da-4352-a40f-09009d7de3e5 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:11.170726 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb0d49-d1da-4352-a40f-09009d7de3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:11.197397 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-39bb0d49-d1da-4352-a40f-09009d7de3e5 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:11.198995 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-39bb0d49-d1da-4352-a40f-09009d7de3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:11.293811 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 164/336] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:39:11.854539 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d738d-81b4-4433-9e2a-86461e631a21 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:11.855280 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d738d-81b4-4433-9e2a-86461e631a21 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:11.855780 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d738d-81b4-4433-9e2a-86461e631a21 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:11.857342 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 173/337] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:11.863277 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f0ae9-12ab-4b83-87c7-66feeb0d5916 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:11.863889 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f0ae9-12ab-4b83-87c7-66feeb0d5916 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:11.864355 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f0ae9-12ab-4b83-87c7-66feeb0d5916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:11.889114 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-dd9f0ae9-12ab-4b83-87c7-66feeb0d5916 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:11.890678 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-dd9f0ae9-12ab-4b83-87c7-66feeb0d5916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:11.959780 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d738d-81b4-4433-9e2a-86461e631a21 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:11.973458 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 165/338] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:39:12.053745 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6f4d6-ba49-4808-ad68-322202e8d177 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:12.054368 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6f4d6-ba49-4808-ad68-322202e8d177 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:12.054874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6f4d6-ba49-4808-ad68-322202e8d177 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:12.057647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 166/339] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:39:12.075138 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26aa510-85e3-45d7-a113-a29c49713a2b None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:12.075844 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26aa510-85e3-45d7-a113-a29c49713a2b None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:12.076596 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26aa510-85e3-45d7-a113-a29c49713a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:12.110897 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-d26aa510-85e3-45d7-a113-a29c49713a2b None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:12.112458 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-d26aa510-85e3-45d7-a113-a29c49713a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:12.146111 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:12.187815 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d738d-81b4-4433-9e2a-86461e631a21 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:12.225329 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:12.257744 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 167/340] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 09:39:12.269169 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2f54c-70b5-40f5-a0fd-f075d48e9b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:12.269838 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2f54c-70b5-40f5-a0fd-f075d48e9b11 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:12.270219 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2f54c-70b5-40f5-a0fd-f075d48e9b11 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:12.270589 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2f54c-70b5-40f5-a0fd-f075d48e9b11 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:12.294849 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2f54c-70b5-40f5-a0fd-f075d48e9b11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:12.299886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-ddd2f54c-70b5-40f5-a0fd-f075d48e9b11 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 09:39:12.299886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:12.299886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:12.299886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:12.299886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:12.299886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:12.299886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:12.299886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:12.299886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:12.299886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:12.299886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:12.299886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:12.299886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:12.299886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:12.299886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:12.299886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:12.300805 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:12.300805 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:12.300805 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:12.300805 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:12.300805 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:12.300805 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:12.300805 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:12.300805 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:12.300805 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:12.300805 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:12.300805 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:12.300805 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:12.300805 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:12.300805 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:12.300805 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:12.300805 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:12.302047 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:12.302047 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:12.302047 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:12.302047 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:12.302047 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:12.302047 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:12.302047 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:12.302047 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:12.302047 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:12.302047 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:12.302047 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 09:39:12.302047 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:12.302047 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 174/341] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 27 09:39:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:12.309329 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26aa510-85e3-45d7-a113-a29c49713a2b None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:12.440582 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26aa510-85e3-45d7-a113-a29c49713a2b None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:12.486537 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b5624-b691-4213-b207-4a76cf94e07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:12.487643 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b5624-b691-4213-b207-4a76cf94e07c None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:12.488323 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b5624-b691-4213-b207-4a76cf94e07c None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:12.488787 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b5624-b691-4213-b207-4a76cf94e07c None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:12.489682 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b5624-b691-4213-b207-4a76cf94e07c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:12.490291 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b5624-b691-4213-b207-4a76cf94e07c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:12.491928 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b5624-b691-4213-b207-4a76cf94e07c None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:12.508495 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 168/342] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:39:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:39:12.519946 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2f54c-70b5-40f5-a0fd-f075d48e9b11 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:12.681071 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2f54c-70b5-40f5-a0fd-f075d48e9b11 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:12.722237 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5ea7b-c78b-4502-9981-faf917d61618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:12.722819 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5ea7b-c78b-4502-9981-faf917d61618 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:12.723909 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5ea7b-c78b-4502-9981-faf917d61618 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:12.723909 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5ea7b-c78b-4502-9981-faf917d61618 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:12.783256 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b5624-b691-4213-b207-4a76cf94e07c None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:12.821013 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:12.836163 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:12.865439 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5ea7b-c78b-4502-9981-faf917d61618 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:12.867528 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5ea7b-c78b-4502-9981-faf917d61618 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:13.057385 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b5624-b691-4213-b207-4a76cf94e07c None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:13.145750 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 175/343] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:39:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:39:13.152156 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5ea7b-c78b-4502-9981-faf917d61618 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:13.205705 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382330d4-bc8a-4fc0-83c4-774852378174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:13.206730 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382330d4-bc8a-4fc0-83c4-774852378174 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:13.207224 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382330d4-bc8a-4fc0-83c4-774852378174 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:13.207683 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382330d4-bc8a-4fc0-83c4-774852378174 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:13.242702 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382330d4-bc8a-4fc0-83c4-774852378174 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:13.255123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-382330d4-bc8a-4fc0-83c4-774852378174 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:39:13.255123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:13.255123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:13.255123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:13.255123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:13.255123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:13.255123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:13.255123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:13.255123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:13.255123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:13.255123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:13.255123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:13.255123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:13.255123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:13.255123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:13.255123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:13.256208 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:13.256208 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:13.256208 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:13.256208 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:13.256208 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:13.256208 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:13.256208 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:13.256208 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:13.256208 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:13.256208 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:13.256208 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:13.256208 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:13.256208 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:13.256208 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:13.256208 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:13.256208 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:13.256998 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:13.256998 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:13.256998 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:13.256998 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:13.256998 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:13.256998 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:13.256998 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:13.256998 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:13.256998 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:13.256998 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:13.256998 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:39:13.256998 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:13.258085 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 169/344] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:39:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 475 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:13.259817 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382330d4-bc8a-4fc0-83c4-774852378174 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:13.380929 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:13.429726 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5ea7b-c78b-4502-9981-faf917d61618 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:13.446466 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:13.490397 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382330d4-bc8a-4fc0-83c4-774852378174 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:13.510518 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ead9f-c2a2-46d5-a1f3-75332562e0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:13.512573 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ead9f-c2a2-46d5-a1f3-75332562e0a6 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:13.512854 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ead9f-c2a2-46d5-a1f3-75332562e0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:13.513135 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ead9f-c2a2-46d5-a1f3-75332562e0a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:13.537397 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ead9f-c2a2-46d5-a1f3-75332562e0a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:13.542739 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-1d7ead9f-c2a2-46d5-a1f3-75332562e0a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:39:13.542739 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:13.542739 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:13.542739 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:13.542739 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:13.542739 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:13.542739 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:13.542739 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:13.542739 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:13.542739 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:13.542739 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:13.542739 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:13.542739 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:13.542739 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:13.542739 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:13.542739 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:13.543842 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:13.543842 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:13.543842 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:13.543842 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:13.543842 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:13.543842 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:13.543842 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:13.543842 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:13.543842 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:13.543842 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:13.543842 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:13.543842 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:13.543842 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:13.543842 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:13.543842 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:13.543842 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:13.544646 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:13.544646 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:13.544646 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:13.544646 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:13.544646 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:13.544646 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:13.544646 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:13.544646 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:13.544646 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:13.544646 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:13.544646 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:39:13.544646 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:13.544646 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 176/345] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:39:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:13.545300 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ead9f-c2a2-46d5-a1f3-75332562e0a6 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:13.553574 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1276e-07f0-4a7a-b2ac-a822ed9f2e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:13.555101 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1276e-07f0-4a7a-b2ac-a822ed9f2e50 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:13.556769 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1276e-07f0-4a7a-b2ac-a822ed9f2e50 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:13.557335 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1276e-07f0-4a7a-b2ac-a822ed9f2e50 None admin] PATH_INFO: `/v3/projects/31d28ae3268846449a1741369164016a` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:13.559029 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1276e-07f0-4a7a-b2ac-a822ed9f2e50 None admin] RBAC: Authorizing `identity:get_project(project_id=31d28ae3268846449a1741369164016a)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:13.560968 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1276e-07f0-4a7a-b2ac-a822ed9f2e50 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:13.564517 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 170/346] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:39:13 2022] GET /identity/v3/projects/31d28ae3268846449a1741369164016a => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:13.567822 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2623993-b3cb-4989-a097-fa6d3a39fc92 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:13.568261 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2623993-b3cb-4989-a097-fa6d3a39fc92 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:13.568494 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2623993-b3cb-4989-a097-fa6d3a39fc92 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:13.571036 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 171/347] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:13.571760 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2623993-b3cb-4989-a097-fa6d3a39fc92 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:13.733942 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ead9f-c2a2-46d5-a1f3-75332562e0a6 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:13.743597 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2623993-b3cb-4989-a097-fa6d3a39fc92 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:13.780396 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239f91f-8665-479e-94ed-5d6b3d4abdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:13.781016 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239f91f-8665-479e-94ed-5d6b3d4abdb1 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:13.783827 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239f91f-8665-479e-94ed-5d6b3d4abdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:13.784080 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239f91f-8665-479e-94ed-5d6b3d4abdb1 None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:13.784746 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239f91f-8665-479e-94ed-5d6b3d4abdb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:13.785060 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239f91f-8665-479e-94ed-5d6b3d4abdb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:13.786908 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239f91f-8665-479e-94ed-5d6b3d4abdb1 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:13.793574 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:13.797307 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02a1fc-9598-4682-ac82-304cbaaa04cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:13.797645 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 177/348] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 27 09:39:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:13.798607 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02a1fc-9598-4682-ac82-304cbaaa04cd None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:13.798715 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239f91f-8665-479e-94ed-5d6b3d4abdb1 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:13.799264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02a1fc-9598-4682-ac82-304cbaaa04cd None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:13.799810 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02a1fc-9598-4682-ac82-304cbaaa04cd None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:13.800745 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02a1fc-9598-4682-ac82-304cbaaa04cd None admin] RBAC: Adding query filter params (name=member) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:13.801470 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02a1fc-9598-4682-ac82-304cbaaa04cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:13.804852 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02a1fc-9598-4682-ac82-304cbaaa04cd None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:13.817304 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 172/349] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 27 09:39:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:13.820220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f08cc-07ca-4f82-a13c-b7ef916b54fb None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:13.821012 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f08cc-07ca-4f82-a13c-b7ef916b54fb None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:13.821518 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f08cc-07ca-4f82-a13c-b7ef916b54fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:13.831843 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:13.852540 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-d08f08cc-07ca-4f82-a13c-b7ef916b54fb None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:13.853779 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-d08f08cc-07ca-4f82-a13c-b7ef916b54fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:13.959672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 173/350] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:39:13.961070 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f08cc-07ca-4f82-a13c-b7ef916b54fb None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:13.983697 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239f91f-8665-479e-94ed-5d6b3d4abdb1 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:14.061905 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fdc77-0bb1-4de5-9845-62b40c2c1b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:14.063005 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fdc77-0bb1-4de5-9845-62b40c2c1b09 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:14.063475 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fdc77-0bb1-4de5-9845-62b40c2c1b09 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:14.063902 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fdc77-0bb1-4de5-9845-62b40c2c1b09 None admin] PATH_INFO: `/v3/groups/316d8830d98648f6a377259b064f0ea6` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:14.084881 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8fdc77-0bb1-4de5-9845-62b40c2c1b09 None admin] RBAC: Authorizing `identity:get_group(group_id=316d8830d98648f6a377259b064f0ea6)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:14.087627 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8fdc77-0bb1-4de5-9845-62b40c2c1b09 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:14.090696 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 178/351] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 27 09:39:13 2022] GET /identity/v3/groups/316d8830d98648f6a377259b064f0ea6 => generated 226 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:14.102937 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fdc77-0bb1-4de5-9845-62b40c2c1b09 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:14.237415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f08cc-07ca-4f82-a13c-b7ef916b54fb None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:14.304180 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:14.305310 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfa6bb-a95b-4776-a126-5a4ca5765ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:14.306336 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfa6bb-a95b-4776-a126-5a4ca5765ad4 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:14.307040 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfa6bb-a95b-4776-a126-5a4ca5765ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:14.307481 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfa6bb-a95b-4776-a126-5a4ca5765ad4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:14.314547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:14.352622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fdc77-0bb1-4de5-9845-62b40c2c1b09 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:14.408312 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250218f-8337-4b3c-ae6c-bdd94eb80b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:14.409260 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250218f-8337-4b3c-ae6c-bdd94eb80b5b None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:14.409741 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250218f-8337-4b3c-ae6c-bdd94eb80b5b None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:14.410140 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250218f-8337-4b3c-ae6c-bdd94eb80b5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:14.431261 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cfa6bb-a95b-4776-a126-5a4ca5765ad4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:14.433122 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cfa6bb-a95b-4776-a126-5a4ca5765ad4 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:14.521695 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250218f-8337-4b3c-ae6c-bdd94eb80b5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:14.523656 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250218f-8337-4b3c-ae6c-bdd94eb80b5b None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:14.585491 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 174/352] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:39:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:39:14.586523 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfa6bb-a95b-4776-a126-5a4ca5765ad4 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:14.632936 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:14.650385 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:14.707170 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 179/353] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:39:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:39:14.708902 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d49434-4df5-4c5c-ae59-79880d01ea9f None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:14.709423 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d49434-4df5-4c5c-ae59-79880d01ea9f None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:14.709928 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d49434-4df5-4c5c-ae59-79880d01ea9f None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:14.711891 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 180/354] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:14.713321 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb574891-a80e-492e-91b9-bc18c43b6957 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:14.713809 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb574891-a80e-492e-91b9-bc18c43b6957 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:14.714076 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb574891-a80e-492e-91b9-bc18c43b6957 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:14.716489 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 181/355] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:14.716489 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb574891-a80e-492e-91b9-bc18c43b6957 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:14.762383 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfa6bb-a95b-4776-a126-5a4ca5765ad4 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:14.812183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032d26a-dcbc-4e83-afe9-2196e25907f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:14.812824 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032d26a-dcbc-4e83-afe9-2196e25907f1 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:14.813101 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032d26a-dcbc-4e83-afe9-2196e25907f1 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:14.813370 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032d26a-dcbc-4e83-afe9-2196e25907f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:14.814121 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032d26a-dcbc-4e83-afe9-2196e25907f1 None admin] RBAC: Adding query filter params (group.id=316d8830d98648f6a377259b064f0ea6, role.id=3c0df08d0ed0435597a1d69ed45a49d4, scope.project.id=31d28ae3268846449a1741369164016a) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:14.814432 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032d26a-dcbc-4e83-afe9-2196e25907f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:14.815966 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032d26a-dcbc-4e83-afe9-2196e25907f1 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:14.824301 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 175/356] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Sep 27 09:39:14 2022] GET /identity/v3/role_assignments?group.id=316d8830d98648f6a377259b064f0ea6&scope.project.id=31d28ae3268846449a1741369164016a&role.id=3c0df08d0ed0435597a1d69ed45a49d4 => generated 260 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:14.825722 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032d26a-dcbc-4e83-afe9-2196e25907f1 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:14.919122 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb574891-a80e-492e-91b9-bc18c43b6957 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:14.980584 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd76667-4326-4610-88f8-6a9eaa445841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:14.981649 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd76667-4326-4610-88f8-6a9eaa445841 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:14.982139 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd76667-4326-4610-88f8-6a9eaa445841 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:14.982610 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd76667-4326-4610-88f8-6a9eaa445841 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:14.998986 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd76667-4326-4610-88f8-6a9eaa445841 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:15.004445 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-efd76667-4326-4610-88f8-6a9eaa445841 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 09:39:15.004445 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:15.004445 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:15.004445 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:15.004445 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:15.004445 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:15.004445 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:15.004445 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:15.004445 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:15.004445 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:15.004445 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:15.004445 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:15.004445 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:15.004445 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:15.004445 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:15.004445 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:15.005565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:15.005565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:15.005565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:15.005565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:15.005565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:15.005565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:15.005565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:15.005565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:15.005565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:15.005565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:15.005565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:15.005565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:15.005565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:15.005565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:15.005565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:15.005565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:15.006444 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:15.006444 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:15.006444 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:15.006444 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:15.006444 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:15.006444 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:15.006444 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:15.006444 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:15.006444 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:15.006444 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:15.006444 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 09:39:15.006444 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:15.009184 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 182/357] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:39:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:15.010309 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd76667-4326-4610-88f8-6a9eaa445841 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:15.017618 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:15.025749 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032d26a-dcbc-4e83-afe9-2196e25907f1 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:15.067770 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8104b2-3af3-4473-85e4-acc45a9f5676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:15.068757 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8104b2-3af3-4473-85e4-acc45a9f5676 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:15.069177 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8104b2-3af3-4473-85e4-acc45a9f5676 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:15.069308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8104b2-3af3-4473-85e4-acc45a9f5676 None admin] PATH_INFO: `/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:15.069415 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:15.071073 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8104b2-3af3-4473-85e4-acc45a9f5676 None admin] RBAC: Authorizing `identity:get_project(project_id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:15.072689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8104b2-3af3-4473-85e4-acc45a9f5676 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:15.076694 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 176/358] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:39:14 2022] GET /identity/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:15.079425 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc2688-f865-4b75-8052-cbdf474836f7 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:15.079923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc2688-f865-4b75-8052-cbdf474836f7 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:15.080372 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc2688-f865-4b75-8052-cbdf474836f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:15.116132 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-e8cc2688-f865-4b75-8052-cbdf474836f7 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:15.118243 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-e8cc2688-f865-4b75-8052-cbdf474836f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:15.191995 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd76667-4326-4610-88f8-6a9eaa445841 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:15.264700 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 177/359] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:39:15.265974 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a15fc-bec8-4224-9b5a-73723ccd255e None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:15.266261 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a15fc-bec8-4224-9b5a-73723ccd255e None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:15.266662 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a15fc-bec8-4224-9b5a-73723ccd255e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:15.280153 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851acb5-34c8-44ab-9c28-be0857fd462d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:15.281131 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851acb5-34c8-44ab-9c28-be0857fd462d None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:15.281663 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851acb5-34c8-44ab-9c28-be0857fd462d None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:15.282115 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851acb5-34c8-44ab-9c28-be0857fd462d None admin] PATH_INFO: `/v3/projects/31d28ae3268846449a1741369164016a` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:15.284192 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851acb5-34c8-44ab-9c28-be0857fd462d None admin] RBAC: Authorizing `identity:get_project(project_id=31d28ae3268846449a1741369164016a)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:15.287309 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851acb5-34c8-44ab-9c28-be0857fd462d None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:15.290344 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 183/360] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:39:15 2022] GET /identity/v3/projects/31d28ae3268846449a1741369164016a => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:15.296508 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851acb5-34c8-44ab-9c28-be0857fd462d None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:15.303201 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-770a15fc-bec8-4224-9b5a-73723ccd255e None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:15.305550 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-770a15fc-bec8-4224-9b5a-73723ccd255e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:15.446275 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 178/361] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:39:15.448677 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a15fc-bec8-4224-9b5a-73723ccd255e None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:15.504172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:15.512472 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:15.542749 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851acb5-34c8-44ab-9c28-be0857fd462d None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:15.664127 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e47b5f-24ae-4397-a531-1fb322b7a183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:15.665547 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e47b5f-24ae-4397-a531-1fb322b7a183 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:15.666201 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e47b5f-24ae-4397-a531-1fb322b7a183 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:15.666952 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e47b5f-24ae-4397-a531-1fb322b7a183 None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:15.669190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e47b5f-24ae-4397-a531-1fb322b7a183 None admin] RBAC: Adding query filter params (name=reader) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:15.669938 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e47b5f-24ae-4397-a531-1fb322b7a183 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:15.673097 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e47b5f-24ae-4397-a531-1fb322b7a183 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:15.703043 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 184/362] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 27 09:39:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:15.706261 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e47b5f-24ae-4397-a531-1fb322b7a183 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:15.733456 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a15fc-bec8-4224-9b5a-73723ccd255e None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:15.793592 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321402b-b915-4f0f-ab8a-0701353b6b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:15.794286 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321402b-b915-4f0f-ab8a-0701353b6b92 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:15.794572 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321402b-b915-4f0f-ab8a-0701353b6b92 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:15.794885 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321402b-b915-4f0f-ab8a-0701353b6b92 None admin] PATH_INFO: `/v3/groups/316d8830d98648f6a377259b064f0ea6` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:15.796435 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321402b-b915-4f0f-ab8a-0701353b6b92 None admin] RBAC: Authorizing `identity:get_group(group_id=316d8830d98648f6a377259b064f0ea6)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:15.798012 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321402b-b915-4f0f-ab8a-0701353b6b92 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:15.800086 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 179/363] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 27 09:39:15 2022] GET /identity/v3/groups/316d8830d98648f6a377259b064f0ea6 => generated 226 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:15.800881 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321402b-b915-4f0f-ab8a-0701353b6b92 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:15.961344 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e47b5f-24ae-4397-a531-1fb322b7a183 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:16.032554 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050d702-a18b-488b-8a73-ceb2c6be0afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:16.033206 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050d702-a18b-488b-8a73-ceb2c6be0afc None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:16.033482 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050d702-a18b-488b-8a73-ceb2c6be0afc None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:16.034042 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050d702-a18b-488b-8a73-ceb2c6be0afc None admin] PATH_INFO: `/v3/groups/316d8830d98648f6a377259b064f0ea6` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:16.035781 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050d702-a18b-488b-8a73-ceb2c6be0afc None admin] RBAC: Authorizing `identity:get_group(group_id=316d8830d98648f6a377259b064f0ea6)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:16.038092 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050d702-a18b-488b-8a73-ceb2c6be0afc None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:16.039373 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:16.041786 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 185/364] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 27 09:39:15 2022] GET /identity/v3/groups/316d8830d98648f6a377259b064f0ea6 => generated 226 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:16.043067 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050d702-a18b-488b-8a73-ceb2c6be0afc None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:16.056729 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321402b-b915-4f0f-ab8a-0701353b6b92 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:16.092634 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:16.143315 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db20f16-a211-4160-a321-d7e2091d6bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:16.144133 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db20f16-a211-4160-a321-d7e2091d6bf8 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:16.144585 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db20f16-a211-4160-a321-d7e2091d6bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:16.145020 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db20f16-a211-4160-a321-d7e2091d6bf8 None admin] PATH_INFO: `/v3/users/5fb9fb359fa345679dd44f68ce56b423` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:16.149590 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db20f16-a211-4160-a321-d7e2091d6bf8 None admin] RBAC: Authorizing `identity:get_user(user_id=5fb9fb359fa345679dd44f68ce56b423)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:16.150997 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db20f16-a211-4160-a321-d7e2091d6bf8 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:16.154276 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 180/365] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Sep 27 09:39:15 2022] GET /identity/v3/users/5fb9fb359fa345679dd44f68ce56b423 => generated 293 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:16.155572 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db20f16-a211-4160-a321-d7e2091d6bf8 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:16.261255 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050d702-a18b-488b-8a73-ceb2c6be0afc None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:16.340414 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a47519-293c-4464-971c-2bed8ecb2408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:16.341352 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a47519-293c-4464-971c-2bed8ecb2408 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:16.341768 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a47519-293c-4464-971c-2bed8ecb2408 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:16.342156 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a47519-293c-4464-971c-2bed8ecb2408 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:16.347162 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db20f16-a211-4160-a321-d7e2091d6bf8 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:16.347909 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a47519-293c-4464-971c-2bed8ecb2408 None admin] RBAC: Adding query filter params (group.id=316d8830d98648f6a377259b064f0ea6, role.id=378cb7fb6a4e4e5e89ab9a0ecb09d86b, scope.project.id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:16.347909 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a47519-293c-4464-971c-2bed8ecb2408 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:16.347909 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a47519-293c-4464-971c-2bed8ecb2408 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:16.358554 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 186/366] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Sep 27 09:39:16 2022] GET /identity/v3/role_assignments?group.id=316d8830d98648f6a377259b064f0ea6&scope.project.id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d&role.id=378cb7fb6a4e4e5e89ab9a0ecb09d86b => generated 260 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:16.360539 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a47519-293c-4464-971c-2bed8ecb2408 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:16.418782 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c0cd2-ed58-419a-a358-2a716cbdf95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:16.419830 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c0cd2-ed58-419a-a358-2a716cbdf95c None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:16.420240 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c0cd2-ed58-419a-a358-2a716cbdf95c None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:16.420635 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c0cd2-ed58-419a-a358-2a716cbdf95c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:16.458399 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c0cd2-ed58-419a-a358-2a716cbdf95c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:16.469887 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-400c0cd2-ed58-419a-a358-2a716cbdf95c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:39:16.469887 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:16.469887 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:16.469887 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:16.469887 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:16.469887 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:16.469887 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:16.469887 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:16.469887 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:16.469887 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:16.469887 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:16.469887 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:16.469887 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:16.469887 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:16.469887 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:16.469887 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:16.471705 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:16.471705 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:16.471705 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:16.471705 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:16.471705 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:16.471705 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:16.471705 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:16.471705 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:16.471705 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:16.471705 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:16.471705 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:16.471705 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:16.471705 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:16.471705 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:16.471705 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:16.471705 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:16.473308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:16.473308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:16.473308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:16.473308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:16.473308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:16.473308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:16.473308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:16.473308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:16.473308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:16.473308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:16.473308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:39:16.473308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:16.473308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 181/367] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 27 09:39:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:16.474623 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c0cd2-ed58-419a-a358-2a716cbdf95c None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:16.533339 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:16.573983 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:16.609687 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a47519-293c-4464-971c-2bed8ecb2408 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:16.644777 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c0cd2-ed58-419a-a358-2a716cbdf95c None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:16.680053 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719068e8-9022-4331-8224-a9a974d7074b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:16.682464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719068e8-9022-4331-8224-a9a974d7074b None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:16.684170 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719068e8-9022-4331-8224-a9a974d7074b None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:16.685437 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719068e8-9022-4331-8224-a9a974d7074b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:16.687457 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719068e8-9022-4331-8224-a9a974d7074b None admin] RBAC: Adding query filter params (group.id=316d8830d98648f6a377259b064f0ea6, role.id=378cb7fb6a4e4e5e89ab9a0ecb09d86b, scope.project.id=31d28ae3268846449a1741369164016a) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:16.688486 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719068e8-9022-4331-8224-a9a974d7074b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:16.690525 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13209cc8-15e3-4e41-b6eb-cd1987f513f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:16.691234 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13209cc8-15e3-4e41-b6eb-cd1987f513f5 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:16.691512 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13209cc8-15e3-4e41-b6eb-cd1987f513f5 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:16.691785 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13209cc8-15e3-4e41-b6eb-cd1987f513f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:16.692844 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719068e8-9022-4331-8224-a9a974d7074b None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:16.705280 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 187/368] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Sep 27 09:39:16 2022] GET /identity/v3/role_assignments?group.id=316d8830d98648f6a377259b064f0ea6&scope.project.id=31d28ae3268846449a1741369164016a&role.id=378cb7fb6a4e4e5e89ab9a0ecb09d86b => generated 260 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:16.706659 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13209cc8-15e3-4e41-b6eb-cd1987f513f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:16.707724 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719068e8-9022-4331-8224-a9a974d7074b None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:16.712790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-13209cc8-15e3-4e41-b6eb-cd1987f513f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 09:39:16.712790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:16.712790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:16.712790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:16.712790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:16.712790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:16.712790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:16.712790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:16.712790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:16.712790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:16.712790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:16.712790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:16.712790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:16.712790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:16.712790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:16.712790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:16.714382 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:16.714382 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:16.714382 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:16.714382 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:16.714382 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:16.714382 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:16.714382 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:16.714382 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:16.714382 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:16.714382 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:16.714382 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:16.714382 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:16.714382 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:16.714382 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:16.714382 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:16.714382 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:16.715895 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:16.715895 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:16.715895 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:16.715895 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:16.715895 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:16.715895 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:16.715895 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:16.715895 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:16.715895 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:16.715895 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:16.715895 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 09:39:16.715895 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:16.720399 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 182/369] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 27 09:39:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:16.720399 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13209cc8-15e3-4e41-b6eb-cd1987f513f5 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:16.998243 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:17.053938 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13209cc8-15e3-4e41-b6eb-cd1987f513f5 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:17.060401 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719068e8-9022-4331-8224-a9a974d7074b None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:17.159027 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d263ee-7188-426a-b5e3-a51a741efdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:17.159592 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb060e-fef3-47fe-85a0-5d3ce1a8d1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:17.160122 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d263ee-7188-426a-b5e3-a51a741efdea None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:17.160271 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb060e-fef3-47fe-85a0-5d3ce1a8d1f2 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:17.160533 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb060e-fef3-47fe-85a0-5d3ce1a8d1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:17.160661 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d263ee-7188-426a-b5e3-a51a741efdea None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:17.160776 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb060e-fef3-47fe-85a0-5d3ce1a8d1f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:17.161425 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d263ee-7188-426a-b5e3-a51a741efdea None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:17.161908 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb060e-fef3-47fe-85a0-5d3ce1a8d1f2 None admin] RBAC: Adding query filter params (role.id=2b7fd974b36e410db7b0003344b6a5f8, user.id=5fb9fb359fa345679dd44f68ce56b423, scope.system=all) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:17.164152 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb060e-fef3-47fe-85a0-5d3ce1a8d1f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:17.164322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d263ee-7188-426a-b5e3-a51a741efdea None admin] RBAC: Adding query filter params (name=admin) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:17.164322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d263ee-7188-426a-b5e3-a51a741efdea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:17.164571 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb060e-fef3-47fe-85a0-5d3ce1a8d1f2 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:17.166045 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d263ee-7188-426a-b5e3-a51a741efdea None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:17.182161 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 183/370] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:39:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:17.183673 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d263ee-7188-426a-b5e3-a51a741efdea None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:17.195502 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 188/371] 10.222.0.49 () {56 vars in 1308 bytes} [Tue Sep 27 09:39:16 2022] GET /identity/v3/role_assignments?user.id=5fb9fb359fa345679dd44f68ce56b423&scope.system=all&role.id=2b7fd974b36e410db7b0003344b6a5f8 => generated 510 bytes in 489 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:17.196762 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb060e-fef3-47fe-85a0-5d3ce1a8d1f2 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:17.232379 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:17.504540 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb060e-fef3-47fe-85a0-5d3ce1a8d1f2 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:17.545380 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d263ee-7188-426a-b5e3-a51a741efdea None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:17.578807 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cf842-f35e-4d91-b7b5-fa11d7545a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:17.578807 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cf842-f35e-4d91-b7b5-fa11d7545a08 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:17.578807 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cf842-f35e-4d91-b7b5-fa11d7545a08 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:17.578807 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cf842-f35e-4d91-b7b5-fa11d7545a08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:17.668025 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ce0eb-d742-4510-a47e-186b610140cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:17.669530 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ce0eb-d742-4510-a47e-186b610140cb None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:17.670251 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ce0eb-d742-4510-a47e-186b610140cb None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:17.671010 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ce0eb-d742-4510-a47e-186b610140cb None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:17.672518 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ce0eb-d742-4510-a47e-186b610140cb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:17.673329 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ce0eb-d742-4510-a47e-186b610140cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:17.676085 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ce0eb-d742-4510-a47e-186b610140cb None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:17.696383 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 184/372] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:39:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 514 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:17.723246 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cf842-f35e-4d91-b7b5-fa11d7545a08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:17.726493 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cf842-f35e-4d91-b7b5-fa11d7545a08 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:17.729047 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ce0eb-d742-4510-a47e-186b610140cb None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:17.746558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:17.755942 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:17.929057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ce0eb-d742-4510-a47e-186b610140cb None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:18.006264 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 189/373] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:39:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 810 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:39:18.012340 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a82f58-8f40-4044-97a5-7fe409096bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:18.013370 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a82f58-8f40-4044-97a5-7fe409096bc9 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:18.013837 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a82f58-8f40-4044-97a5-7fe409096bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:18.016223 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cf842-f35e-4d91-b7b5-fa11d7545a08 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:18.019407 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a82f58-8f40-4044-97a5-7fe409096bc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:18.231381 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a82f58-8f40-4044-97a5-7fe409096bc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:18.232878 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a82f58-8f40-4044-97a5-7fe409096bc9 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:18.248238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:18.365778 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cf842-f35e-4d91-b7b5-fa11d7545a08 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:18.383249 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:18.422472 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c2bba-575e-40b4-a9aa-a0e5a8919c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:18.423605 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c2bba-575e-40b4-a9aa-a0e5a8919c13 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:18.424098 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c2bba-575e-40b4-a9aa-a0e5a8919c13 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:18.424598 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c2bba-575e-40b4-a9aa-a0e5a8919c13 None admin] PATH_INFO: `/v3/projects/50dc269bfa7c47b5b3c652045ebe51ff` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:18.426194 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c2bba-575e-40b4-a9aa-a0e5a8919c13 None admin] RBAC: Authorizing `identity:get_project(project_id=50dc269bfa7c47b5b3c652045ebe51ff)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:18.428545 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c2bba-575e-40b4-a9aa-a0e5a8919c13 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:18.430798 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 190/374] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:39:18 2022] GET /identity/v3/projects/50dc269bfa7c47b5b3c652045ebe51ff => generated 344 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:18.441219 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c2bba-575e-40b4-a9aa-a0e5a8919c13 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:18.547980 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 185/375] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:39:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 820 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:39:18.603939 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a82f58-8f40-4044-97a5-7fe409096bc9 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:18.719297 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c2bba-575e-40b4-a9aa-a0e5a8919c13 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:18.800817 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6fd982-880d-4533-bdd0-d1639f2ba3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:18.801929 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fd982-880d-4533-bdd0-d1639f2ba3f1 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:18.802438 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fd982-880d-4533-bdd0-d1639f2ba3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:18.803979 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fd982-880d-4533-bdd0-d1639f2ba3f1 None admin] PATH_INFO: `/v3/groups/8d7f1df077e34dbe927f137abd17960c` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:18.828160 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6fd982-880d-4533-bdd0-d1639f2ba3f1 None admin] RBAC: Authorizing `identity:get_group(group_id=8d7f1df077e34dbe927f137abd17960c)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:18.830988 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6fd982-880d-4533-bdd0-d1639f2ba3f1 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:18.834098 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 191/376] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 27 09:39:18 2022] GET /identity/v3/groups/8d7f1df077e34dbe927f137abd17960c => generated 229 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:39:18.860564 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6fd982-880d-4533-bdd0-d1639f2ba3f1 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:18.899841 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a82f58-8f40-4044-97a5-7fe409096bc9 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:18.920070 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:18.979321 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:18.982077 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50a47e-87c7-419b-9415-bcada2d1d1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:18.983114 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50a47e-87c7-419b-9415-bcada2d1d1ac None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:18.983553 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50a47e-87c7-419b-9415-bcada2d1d1ac None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:18.984033 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50a47e-87c7-419b-9415-bcada2d1d1ac None admin] PATH_INFO: `/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:18.986244 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b50a47e-87c7-419b-9415-bcada2d1d1ac None admin] RBAC: Authorizing `identity:get_project(project_id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:18.989167 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b50a47e-87c7-419b-9415-bcada2d1d1ac None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:18.992895 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 186/377] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:39:18 2022] GET /identity/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d => generated 302 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:19.011794 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50a47e-87c7-419b-9415-bcada2d1d1ac None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:19.106734 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6fd982-880d-4533-bdd0-d1639f2ba3f1 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:19.173209 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa8a4c-2e3b-4438-a5a0-a940137003a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:19.174515 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa8a4c-2e3b-4438-a5a0-a940137003a0 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:19.175255 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa8a4c-2e3b-4438-a5a0-a940137003a0 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:19.175878 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa8a4c-2e3b-4438-a5a0-a940137003a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:19.177645 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa8a4c-2e3b-4438-a5a0-a940137003a0 None admin] RBAC: Adding query filter params (group.id=8d7f1df077e34dbe927f137abd17960c, role.id=7cc7d3c85c794033b590117321e97ccf, scope.project.id=50dc269bfa7c47b5b3c652045ebe51ff) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:19.178373 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa8a4c-2e3b-4438-a5a0-a940137003a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:19.181197 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa8a4c-2e3b-4438-a5a0-a940137003a0 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:19.192707 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 192/378] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Sep 27 09:39:18 2022] GET /identity/v3/role_assignments?group.id=8d7f1df077e34dbe927f137abd17960c&scope.project.id=50dc269bfa7c47b5b3c652045ebe51ff&role.id=7cc7d3c85c794033b590117321e97ccf => generated 260 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:19.195763 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ba50f-ead8-4f49-9544-8169b652d1ef None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:19.196787 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ba50f-ead8-4f49-9544-8169b652d1ef None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:19.197530 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ba50f-ead8-4f49-9544-8169b652d1ef None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:19.200810 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 193/379] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:19.213516 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878a63b-9b7f-431f-a149-98d07541a8f8 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:19.214434 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878a63b-9b7f-431f-a149-98d07541a8f8 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:19.215221 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878a63b-9b7f-431f-a149-98d07541a8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:19.274751 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-0878a63b-9b7f-431f-a149-98d07541a8f8 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:19.275231 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50a47e-87c7-419b-9415-bcada2d1d1ac None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:19.276904 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-0878a63b-9b7f-431f-a149-98d07541a8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:19.391861 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7450697-8ee4-4d1f-8693-623d021e0fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:19.392981 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7450697-8ee4-4d1f-8693-623d021e0fe6 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:19.393469 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7450697-8ee4-4d1f-8693-623d021e0fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:19.393954 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7450697-8ee4-4d1f-8693-623d021e0fe6 None admin] PATH_INFO: `/v3/groups/316d8830d98648f6a377259b064f0ea6` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:19.399075 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7450697-8ee4-4d1f-8693-623d021e0fe6 None admin] RBAC: Authorizing `identity:get_group(group_id=316d8830d98648f6a377259b064f0ea6)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:19.403449 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7450697-8ee4-4d1f-8693-623d021e0fe6 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:19.406997 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 187/380] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 27 09:39:19 2022] GET /identity/v3/groups/316d8830d98648f6a377259b064f0ea6 => generated 226 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:39:19.418477 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7450697-8ee4-4d1f-8693-623d021e0fe6 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:19.519805 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 194/381] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:39:19.566965 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:19.690629 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7450697-8ee4-4d1f-8693-623d021e0fe6 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:19.765608 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3693127-be33-4219-89a8-5a7b5efaf674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:19.766245 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3693127-be33-4219-89a8-5a7b5efaf674 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:19.766517 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3693127-be33-4219-89a8-5a7b5efaf674 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:19.766796 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3693127-be33-4219-89a8-5a7b5efaf674 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:19.767553 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3693127-be33-4219-89a8-5a7b5efaf674 None admin] RBAC: Adding query filter params (group.id=316d8830d98648f6a377259b064f0ea6, role.id=3c0df08d0ed0435597a1d69ed45a49d4, scope.project.id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:19.767852 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3693127-be33-4219-89a8-5a7b5efaf674 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:19.769324 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3693127-be33-4219-89a8-5a7b5efaf674 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:19.779913 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 188/382] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Sep 27 09:39:19 2022] GET /identity/v3/role_assignments?group.id=316d8830d98648f6a377259b064f0ea6&scope.project.id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d&role.id=3c0df08d0ed0435597a1d69ed45a49d4 => generated 260 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:20.015757 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b798789-e7b1-400d-9228-570121882e58 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:20.016556 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b798789-e7b1-400d-9228-570121882e58 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:20.016556 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b798789-e7b1-400d-9228-570121882e58 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:20.017666 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 195/383] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:20.024082 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163e11d-f32f-470f-b7ca-871beec37f3d None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:20.024339 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163e11d-f32f-470f-b7ca-871beec37f3d None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:20.024635 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163e11d-f32f-470f-b7ca-871beec37f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:20.053231 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-e163e11d-f32f-470f-b7ca-871beec37f3d None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:20.054451 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-e163e11d-f32f-470f-b7ca-871beec37f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:20.164951 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 189/384] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:39:20.266196 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b798789-e7b1-400d-9228-570121882e58 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:20.345233 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:20.491685 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b798789-e7b1-400d-9228-570121882e58 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:20.538492 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163e11d-f32f-470f-b7ca-871beec37f3d None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:20.544025 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728479c7-ef59-4ef0-944d-4e0296630836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:20.544950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728479c7-ef59-4ef0-944d-4e0296630836 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:20.545368 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728479c7-ef59-4ef0-944d-4e0296630836 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:20.545803 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728479c7-ef59-4ef0-944d-4e0296630836 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:20.579720 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728479c7-ef59-4ef0-944d-4e0296630836 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:20.596769 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-728479c7-ef59-4ef0-944d-4e0296630836 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 09:39:20.596769 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:20.596769 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:20.596769 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:20.596769 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:20.596769 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:20.596769 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:20.596769 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:20.596769 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:20.596769 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:20.596769 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:20.596769 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:20.596769 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:20.596769 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:20.596769 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:20.596769 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:20.597831 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:20.597831 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:20.597831 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:20.597831 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:20.597831 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:20.597831 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:20.597831 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:20.597831 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:20.597831 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:20.597831 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:20.597831 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:20.597831 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:20.597831 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:20.597831 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:20.597831 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:20.597831 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:20.598606 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:20.598606 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:20.598606 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:20.598606 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:20.598606 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:20.598606 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:20.598606 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:20.598606 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:20.598606 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:20.598606 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:20.598606 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 09:39:20.598606 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:20.604945 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 196/385] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 27 09:39:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 09:39:20.606544 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728479c7-ef59-4ef0-944d-4e0296630836 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:20.659319 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:20.879738 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163e11d-f32f-470f-b7ca-871beec37f3d None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:20.928664 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:20.945349 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728479c7-ef59-4ef0-944d-4e0296630836 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:20.967593 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9651e6-bcd3-45c2-a33c-b842954333d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:20.968275 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9651e6-bcd3-45c2-a33c-b842954333d0 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:20.968553 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9651e6-bcd3-45c2-a33c-b842954333d0 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:20.968832 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9651e6-bcd3-45c2-a33c-b842954333d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:20.994615 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9651e6-bcd3-45c2-a33c-b842954333d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:21.003290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-0b9651e6-bcd3-45c2-a33c-b842954333d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:39:21.003290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:21.003290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:21.003290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:21.003290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:21.003290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:21.003290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:21.003290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:21.003290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:21.003290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:21.003290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:21.003290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:21.003290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:21.003290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:21.003290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:21.003290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:21.004506 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:21.004506 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:21.004506 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:21.004506 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:21.004506 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:21.004506 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:21.004506 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:21.004506 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:21.004506 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:21.004506 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:21.004506 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:21.004506 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:21.004506 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:21.004506 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:21.004506 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:21.004506 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:21.005625 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:21.005625 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:21.005625 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:21.005625 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:21.005625 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:21.005625 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:21.005625 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:21.005625 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:21.005625 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:21.005625 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:21.005625 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:39:21.005625 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:21.010920 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 190/386] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:39:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 471 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:21.015229 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9651e6-bcd3-45c2-a33c-b842954333d0 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:21.024736 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee3933-1722-42a3-915a-9c2c29a3d696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:21.025998 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee3933-1722-42a3-915a-9c2c29a3d696 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:21.026423 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee3933-1722-42a3-915a-9c2c29a3d696 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:21.032565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee3933-1722-42a3-915a-9c2c29a3d696 None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:21.033633 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee3933-1722-42a3-915a-9c2c29a3d696 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:21.034108 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee3933-1722-42a3-915a-9c2c29a3d696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:21.035811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee3933-1722-42a3-915a-9c2c29a3d696 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:21.052105 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 197/387] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:39:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:21.053800 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521d293-0e67-4ed8-b351-9fa16dbe0778 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:21.054199 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521d293-0e67-4ed8-b351-9fa16dbe0778 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:21.054622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521d293-0e67-4ed8-b351-9fa16dbe0778 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:21.056153 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 198/388] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:21.057067 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521d293-0e67-4ed8-b351-9fa16dbe0778 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:21.148118 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:21.155541 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9651e6-bcd3-45c2-a33c-b842954333d0 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:21.185750 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521d293-0e67-4ed8-b351-9fa16dbe0778 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:21.197110 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc538051-e1df-4339-80a7-fbd99dde7360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:21.197761 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc538051-e1df-4339-80a7-fbd99dde7360 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:21.198040 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc538051-e1df-4339-80a7-fbd99dde7360 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:21.198383 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc538051-e1df-4339-80a7-fbd99dde7360 None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:21.199106 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc538051-e1df-4339-80a7-fbd99dde7360 None admin] RBAC: Adding query filter params (name=member) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:21.199408 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc538051-e1df-4339-80a7-fbd99dde7360 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:21.200979 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc538051-e1df-4339-80a7-fbd99dde7360 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:21.214826 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 191/389] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 27 09:39:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:21.214826 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccb209-2386-402d-afcb-9c132b659130 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:21.214826 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccb209-2386-402d-afcb-9c132b659130 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:21.214826 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccb209-2386-402d-afcb-9c132b659130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:21.232887 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c6557-6939-48d5-bb84-3cfe365720c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:21.233928 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c6557-6939-48d5-bb84-3cfe365720c2 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:21.234123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-02ccb209-2386-402d-afcb-9c132b659130 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:21.234587 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c6557-6939-48d5-bb84-3cfe365720c2 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:21.235093 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c6557-6939-48d5-bb84-3cfe365720c2 None admin] PATH_INFO: `/v3/groups/316d8830d98648f6a377259b064f0ea6` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:21.235378 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-02ccb209-2386-402d-afcb-9c132b659130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:21.236759 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c6557-6939-48d5-bb84-3cfe365720c2 None admin] RBAC: Authorizing `identity:get_group(group_id=316d8830d98648f6a377259b064f0ea6)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:21.238708 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c6557-6939-48d5-bb84-3cfe365720c2 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:21.240729 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 199/390] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 27 09:39:21 2022] GET /identity/v3/groups/316d8830d98648f6a377259b064f0ea6 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:21.246691 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c6557-6939-48d5-bb84-3cfe365720c2 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:21.276651 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:21.323330 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 192/391] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:39:21.324354 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccb209-2386-402d-afcb-9c132b659130 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:21.388510 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c6557-6939-48d5-bb84-3cfe365720c2 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:21.425710 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:21.455380 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f70af-df4f-4968-8b60-c8be96c568a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:21.456455 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f70af-df4f-4968-8b60-c8be96c568a5 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:21.456854 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccb209-2386-402d-afcb-9c132b659130 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:21.457381 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f70af-df4f-4968-8b60-c8be96c568a5 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:21.458060 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f70af-df4f-4968-8b60-c8be96c568a5 None admin] PATH_INFO: `/v3/groups/316d8830d98648f6a377259b064f0ea6` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:21.460435 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f70af-df4f-4968-8b60-c8be96c568a5 None admin] RBAC: Authorizing `identity:get_group(group_id=316d8830d98648f6a377259b064f0ea6)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:21.463287 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f70af-df4f-4968-8b60-c8be96c568a5 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:21.466497 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 200/392] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 27 09:39:21 2022] GET /identity/v3/groups/316d8830d98648f6a377259b064f0ea6 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:21.474382 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f70af-df4f-4968-8b60-c8be96c568a5 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:21.524236 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df9812-6c26-4a95-a9e3-1ee2f54741bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:21.524899 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df9812-6c26-4a95-a9e3-1ee2f54741bb None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:21.525182 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df9812-6c26-4a95-a9e3-1ee2f54741bb None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:21.525438 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df9812-6c26-4a95-a9e3-1ee2f54741bb None admin] PATH_INFO: `/v3/projects/31d28ae3268846449a1741369164016a` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:21.529117 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df9812-6c26-4a95-a9e3-1ee2f54741bb None admin] RBAC: Authorizing `identity:get_project(project_id=31d28ae3268846449a1741369164016a)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:21.530738 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df9812-6c26-4a95-a9e3-1ee2f54741bb None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:21.532831 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 193/393] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:39:21 2022] GET /identity/v3/projects/31d28ae3268846449a1741369164016a => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:21.538985 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df9812-6c26-4a95-a9e3-1ee2f54741bb None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:21.657142 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:21.674186 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f70af-df4f-4968-8b60-c8be96c568a5 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:21.747993 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69a9ef-ea05-4eb9-b777-70fe74525ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:21.749524 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69a9ef-ea05-4eb9-b777-70fe74525ee4 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:21.750280 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69a9ef-ea05-4eb9-b777-70fe74525ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:21.751008 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69a9ef-ea05-4eb9-b777-70fe74525ee4 None admin] PATH_INFO: `/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:21.753375 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69a9ef-ea05-4eb9-b777-70fe74525ee4 None admin] RBAC: Authorizing `identity:get_project(project_id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:21.757570 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69a9ef-ea05-4eb9-b777-70fe74525ee4 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:21.761579 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 201/394] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:39:21 2022] GET /identity/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:21.776340 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69a9ef-ea05-4eb9-b777-70fe74525ee4 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:21.795042 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df9812-6c26-4a95-a9e3-1ee2f54741bb None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:21.851243 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c41d2a-b3ad-4c61-a8cd-52810f4c4fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:21.852348 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c41d2a-b3ad-4c61-a8cd-52810f4c4fc5 None admin] REQUEST_METHOD: `PUT` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:21.852778 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c41d2a-b3ad-4c61-a8cd-52810f4c4fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:21.853213 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c41d2a-b3ad-4c61-a8cd-52810f4c4fc5 None admin] PATH_INFO: `/v3/projects/31d28ae3268846449a1741369164016a/groups/316d8830d98648f6a377259b064f0ea6/roles/3c0df08d0ed0435597a1d69ed45a49d4` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:21.857021 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c41d2a-b3ad-4c61-a8cd-52810f4c4fc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=31d28ae3268846449a1741369164016a, group_id=316d8830d98648f6a377259b064f0ea6, role_id=3c0df08d0ed0435597a1d69ed45a49d4)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:21.859980 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c41d2a-b3ad-4c61-a8cd-52810f4c4fc5 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:21.913881 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 194/395] 10.222.0.49 () {58 vars in 1442 bytes} [Tue Sep 27 09:39:21 2022] PUT /identity/v3/projects/31d28ae3268846449a1741369164016a/groups/316d8830d98648f6a377259b064f0ea6/roles/3c0df08d0ed0435597a1d69ed45a49d4 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 09:39:21.956178 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c41d2a-b3ad-4c61-a8cd-52810f4c4fc5 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:21.993768 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:21.994675 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69a9ef-ea05-4eb9-b777-70fe74525ee4 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:22.037709 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f0a6c-d92c-4385-ae18-e98de32edbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:22.038750 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f0a6c-d92c-4385-ae18-e98de32edbf6 None admin] REQUEST_METHOD: `PUT` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:22.038750 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f0a6c-d92c-4385-ae18-e98de32edbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:22.039022 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f0a6c-d92c-4385-ae18-e98de32edbf6 None admin] PATH_INFO: `/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d/groups/316d8830d98648f6a377259b064f0ea6/roles/378cb7fb6a4e4e5e89ab9a0ecb09d86b` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:22.040962 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f0a6c-d92c-4385-ae18-e98de32edbf6 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d, group_id=316d8830d98648f6a377259b064f0ea6, role_id=378cb7fb6a4e4e5e89ab9a0ecb09d86b)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:22.042484 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f0a6c-d92c-4385-ae18-e98de32edbf6 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:22.062434 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 202/396] 10.222.0.49 () {58 vars in 1442 bytes} [Tue Sep 27 09:39:21 2022] PUT /identity/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d/groups/316d8830d98648f6a377259b064f0ea6/roles/378cb7fb6a4e4e5e89ab9a0ecb09d86b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 09:39:22.160080 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c41d2a-b3ad-4c61-a8cd-52810f4c4fc5 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:22.220946 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeed672-e8ee-4b93-a6e9-afbcddc2f832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:22.221620 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeed672-e8ee-4b93-a6e9-afbcddc2f832 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:22.221893 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeed672-e8ee-4b93-a6e9-afbcddc2f832 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:22.222152 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeed672-e8ee-4b93-a6e9-afbcddc2f832 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:22.239848 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeed672-e8ee-4b93-a6e9-afbcddc2f832 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:22.245130 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-5aeed672-e8ee-4b93-a6e9-afbcddc2f832 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:39:22.245130 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:22.245130 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:22.245130 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:22.245130 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:22.245130 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:22.245130 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:22.245130 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:22.245130 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:22.245130 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:22.245130 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:22.245130 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:22.245130 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:22.245130 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:22.245130 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:22.245130 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:22.248541 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:22.248541 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:22.248541 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:22.248541 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:22.248541 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:22.248541 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:22.248541 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:22.248541 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:22.248541 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:22.248541 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:22.248541 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:22.248541 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:22.248541 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:22.248541 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:22.248541 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:22.248541 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:22.251529 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:22.251529 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:22.251529 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:22.251529 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:22.251529 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:22.251529 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:22.251529 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:22.251529 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:22.251529 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:22.251529 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:22.251529 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:39:22.251529 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:22.263310 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 195/397] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:39:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:22.276230 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f0a6c-d92c-4385-ae18-e98de32edbf6 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:22.310407 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:22.437835 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f0a6c-d92c-4385-ae18-e98de32edbf6 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:22.492742 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51998260-39d5-41cc-bf71-5050da7193ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:22.493409 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51998260-39d5-41cc-bf71-5050da7193ee None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:22.493704 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51998260-39d5-41cc-bf71-5050da7193ee None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:22.493940 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51998260-39d5-41cc-bf71-5050da7193ee None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:22.494632 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51998260-39d5-41cc-bf71-5050da7193ee None admin] RBAC: Adding query filter params (name=member) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:22.494971 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51998260-39d5-41cc-bf71-5050da7193ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:22.496404 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51998260-39d5-41cc-bf71-5050da7193ee None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:22.516184 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 203/398] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 27 09:39:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:22.526516 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeed672-e8ee-4b93-a6e9-afbcddc2f832 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:22.669873 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:22.716899 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeed672-e8ee-4b93-a6e9-afbcddc2f832 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:22.788255 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89f413-1d35-4641-94fe-a5f16ef212c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:22.789389 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89f413-1d35-4641-94fe-a5f16ef212c9 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:22.789871 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89f413-1d35-4641-94fe-a5f16ef212c9 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:22.790342 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89f413-1d35-4641-94fe-a5f16ef212c9 None admin] PATH_INFO: `/v3/groups/316d8830d98648f6a377259b064f0ea6` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:22.792815 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89f413-1d35-4641-94fe-a5f16ef212c9 None admin] RBAC: Authorizing `identity:get_group(group_id=316d8830d98648f6a377259b064f0ea6)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:22.795776 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89f413-1d35-4641-94fe-a5f16ef212c9 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:22.799580 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 196/399] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 27 09:39:22 2022] GET /identity/v3/groups/316d8830d98648f6a377259b064f0ea6 => generated 226 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:22.805628 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51998260-39d5-41cc-bf71-5050da7193ee None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:22.928960 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:22.948642 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3ec09-e5d1-4540-9156-4967270236c5 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:22.949081 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3ec09-e5d1-4540-9156-4967270236c5 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:22.949505 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3ec09-e5d1-4540-9156-4967270236c5 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:22.954912 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51998260-39d5-41cc-bf71-5050da7193ee None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:22.964863 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 197/400] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:22 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:22.968543 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df773a-e2f6-42bb-b4fa-0b28de86150c None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:22.968813 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df773a-e2f6-42bb-b4fa-0b28de86150c None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:22.969082 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df773a-e2f6-42bb-b4fa-0b28de86150c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:23.005253 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-a9df773a-e2f6-42bb-b4fa-0b28de86150c None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:23.006552 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-a9df773a-e2f6-42bb-b4fa-0b28de86150c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:23.019018 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d7b9c-a455-4aa9-80e0-8cc0906fdc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:23.019687 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d7b9c-a455-4aa9-80e0-8cc0906fdc0a None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:23.019962 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d7b9c-a455-4aa9-80e0-8cc0906fdc0a None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:23.020232 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d7b9c-a455-4aa9-80e0-8cc0906fdc0a None admin] PATH_INFO: `/v3/projects/31d28ae3268846449a1741369164016a` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:23.021540 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d7b9c-a455-4aa9-80e0-8cc0906fdc0a None admin] RBAC: Authorizing `identity:get_project(project_id=31d28ae3268846449a1741369164016a)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:23.023077 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d7b9c-a455-4aa9-80e0-8cc0906fdc0a None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:23.025113 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 204/401] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:39:22 2022] GET /identity/v3/projects/31d28ae3268846449a1741369164016a => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:23.031151 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d7b9c-a455-4aa9-80e0-8cc0906fdc0a None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:23.126915 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 198/402] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:39:23.211623 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d7b9c-a455-4aa9-80e0-8cc0906fdc0a None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:23.250882 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cfc81-7136-4f69-a04f-d86ffc10fe5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:23.251925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cfc81-7136-4f69-a04f-d86ffc10fe5d None admin] REQUEST_METHOD: `PUT` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:23.252403 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cfc81-7136-4f69-a04f-d86ffc10fe5d None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:23.252872 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cfc81-7136-4f69-a04f-d86ffc10fe5d None admin] PATH_INFO: `/v3/projects/31d28ae3268846449a1741369164016a/groups/316d8830d98648f6a377259b064f0ea6/roles/378cb7fb6a4e4e5e89ab9a0ecb09d86b` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:23.255240 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6cfc81-7136-4f69-a04f-d86ffc10fe5d None admin] RBAC: Authorizing `identity:create_grant(project_id=31d28ae3268846449a1741369164016a, group_id=316d8830d98648f6a377259b064f0ea6, role_id=378cb7fb6a4e4e5e89ab9a0ecb09d86b)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:23.257282 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6cfc81-7136-4f69-a04f-d86ffc10fe5d None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:23.279489 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 205/403] 10.222.0.49 () {58 vars in 1442 bytes} [Tue Sep 27 09:39:23 2022] PUT /identity/v3/projects/31d28ae3268846449a1741369164016a/groups/316d8830d98648f6a377259b064f0ea6/roles/378cb7fb6a4e4e5e89ab9a0ecb09d86b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 09:39:23.682094 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febd0e8-6281-4634-8d1b-812898404767 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:23.683115 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febd0e8-6281-4634-8d1b-812898404767 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:23.683850 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febd0e8-6281-4634-8d1b-812898404767 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:23.687054 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 199/404] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:23.689345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cfc81-7136-4f69-a04f-d86ffc10fe5d None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:23.693529 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef2b3f-7b8a-40db-8710-e1a645529dc2 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:23.694433 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef2b3f-7b8a-40db-8710-e1a645529dc2 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:23.695164 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef2b3f-7b8a-40db-8710-e1a645529dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:23.729739 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-4eef2b3f-7b8a-40db-8710-e1a645529dc2 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:23.731161 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:23.731336 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-4eef2b3f-7b8a-40db-8710-e1a645529dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:23.912241 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 200/405] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:39:23.925122 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cfc81-7136-4f69-a04f-d86ffc10fe5d None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:23.993577 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676bf80d-bc1b-4721-90e2-f705d31bffd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:23.995116 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bf80d-bc1b-4721-90e2-f705d31bffd7 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:23.995903 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bf80d-bc1b-4721-90e2-f705d31bffd7 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:23.996830 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bf80d-bc1b-4721-90e2-f705d31bffd7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:24.018982 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676bf80d-bc1b-4721-90e2-f705d31bffd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:24.042823 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-676bf80d-bc1b-4721-90e2-f705d31bffd7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:39:24.042823 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:24.042823 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:24.042823 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:24.042823 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:24.042823 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:24.042823 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:24.042823 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:24.042823 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:24.042823 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:24.042823 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:24.042823 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:24.042823 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:24.042823 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:24.042823 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:24.042823 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:24.044571 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:24.044571 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:24.044571 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:24.044571 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:24.044571 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:24.044571 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:24.044571 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:24.044571 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:24.044571 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:24.044571 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:24.044571 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:24.044571 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:24.044571 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:24.044571 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:24.044571 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:24.044571 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:24.046211 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:24.046211 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:24.046211 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:24.046211 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:24.046211 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:24.046211 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:24.046211 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:24.046211 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:24.046211 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:24.046211 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:24.046211 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:39:24.046211 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:24.051927 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 206/406] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 27 09:39:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:24.061722 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef2b3f-7b8a-40db-8710-e1a645529dc2 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:24.079316 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:24.411408 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef2b3f-7b8a-40db-8710-e1a645529dc2 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:24.488880 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4d8c3-2b59-4d58-8061-8ba09e643614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:24.489524 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4d8c3-2b59-4d58-8061-8ba09e643614 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:24.489874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4d8c3-2b59-4d58-8061-8ba09e643614 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:24.490109 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4d8c3-2b59-4d58-8061-8ba09e643614 None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:24.490966 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4d8c3-2b59-4d58-8061-8ba09e643614 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:24.491262 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4d8c3-2b59-4d58-8061-8ba09e643614 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:24.492785 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4d8c3-2b59-4d58-8061-8ba09e643614 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:24.510299 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 201/407] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:39:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:24.517427 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676bf80d-bc1b-4721-90e2-f705d31bffd7 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:24.772105 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:24.815771 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4d8c3-2b59-4d58-8061-8ba09e643614 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:24.860544 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676bf80d-bc1b-4721-90e2-f705d31bffd7 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:24.972446 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dada0a-bb25-47fb-b720-33e81ffce82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:24.972446 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dada0a-bb25-47fb-b720-33e81ffce82d None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:24.972446 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dada0a-bb25-47fb-b720-33e81ffce82d None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:24.972446 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dada0a-bb25-47fb-b720-33e81ffce82d None admin] PATH_INFO: `/v3/groups/8d7f1df077e34dbe927f137abd17960c` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:24.974815 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dada0a-bb25-47fb-b720-33e81ffce82d None admin] RBAC: Authorizing `identity:get_group(group_id=8d7f1df077e34dbe927f137abd17960c)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:24.977617 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dada0a-bb25-47fb-b720-33e81ffce82d None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:24.992255 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 207/408] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 27 09:39:24 2022] GET /identity/v3/groups/8d7f1df077e34dbe927f137abd17960c => generated 229 bytes in 476 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:24.998743 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dada0a-bb25-47fb-b720-33e81ffce82d None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:25.044998 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:25.149034 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4d8c3-2b59-4d58-8061-8ba09e643614 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:25.250010 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dada0a-bb25-47fb-b720-33e81ffce82d None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:25.265478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd95e1-351a-4b9a-8599-257473d4d1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:25.267060 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd95e1-351a-4b9a-8599-257473d4d1b1 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:25.267844 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd95e1-351a-4b9a-8599-257473d4d1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:25.268602 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd95e1-351a-4b9a-8599-257473d4d1b1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:25.312718 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd95e1-351a-4b9a-8599-257473d4d1b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:25.326884 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8420973-bc58-4f74-988e-7ebae7d071f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:25.326884 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8420973-bc58-4f74-988e-7ebae7d071f5 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:25.326884 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8420973-bc58-4f74-988e-7ebae7d071f5 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:25.326884 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8420973-bc58-4f74-988e-7ebae7d071f5 None admin] PATH_INFO: `/v3/projects/50dc269bfa7c47b5b3c652045ebe51ff` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:25.327562 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8420973-bc58-4f74-988e-7ebae7d071f5 None admin] RBAC: Authorizing `identity:get_project(project_id=50dc269bfa7c47b5b3c652045ebe51ff)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:25.328077 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8420973-bc58-4f74-988e-7ebae7d071f5 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:25.331797 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 208/409] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:39:24 2022] GET /identity/v3/projects/50dc269bfa7c47b5b3c652045ebe51ff => generated 344 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:39:25.334631 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-28fd95e1-351a-4b9a-8599-257473d4d1b1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 09:39:25.334631 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:25.334631 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:25.334631 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:25.334631 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:25.334631 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:25.334631 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:25.334631 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:25.334631 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:25.334631 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:25.334631 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:25.334631 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:25.334631 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:25.334631 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:25.334631 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:25.334631 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:25.336475 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:25.336475 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:25.336475 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:25.336475 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:25.336475 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:25.336475 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:25.336475 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:25.336475 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:25.336475 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:25.336475 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:25.336475 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:25.336475 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:25.336475 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:25.336475 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:25.336475 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:25.336475 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:25.338146 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:25.338146 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:25.338146 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:25.338146 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:25.338146 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:25.338146 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:25.338146 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:25.338146 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:25.338146 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:25.338146 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:25.338146 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 09:39:25.338146 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:25.342226 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 202/410] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 27 09:39:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 527 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:25.346995 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8420973-bc58-4f74-988e-7ebae7d071f5 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:25.354712 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd95e1-351a-4b9a-8599-257473d4d1b1 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:25.376656 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:25.613387 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd95e1-351a-4b9a-8599-257473d4d1b1 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:25.654435 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8420973-bc58-4f74-988e-7ebae7d071f5 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:25.679238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:25.701028 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745abe6-e813-456b-bc2b-40e6009779cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:25.701660 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745abe6-e813-456b-bc2b-40e6009779cf None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:25.701937 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745abe6-e813-456b-bc2b-40e6009779cf None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:25.702205 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745abe6-e813-456b-bc2b-40e6009779cf None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:25.702908 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9745abe6-e813-456b-bc2b-40e6009779cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:25.703211 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9745abe6-e813-456b-bc2b-40e6009779cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:25.704605 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9745abe6-e813-456b-bc2b-40e6009779cf None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:25.722507 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 203/411] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:39:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:25.740687 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745abe6-e813-456b-bc2b-40e6009779cf None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:25.742471 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abe568-9562-4ace-866d-61aaaa57ce2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:25.744030 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abe568-9562-4ace-866d-61aaaa57ce2a None admin] REQUEST_METHOD: `PUT` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:25.744817 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abe568-9562-4ace-866d-61aaaa57ce2a None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:25.745585 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abe568-9562-4ace-866d-61aaaa57ce2a None admin] PATH_INFO: `/v3/projects/50dc269bfa7c47b5b3c652045ebe51ff/groups/8d7f1df077e34dbe927f137abd17960c/roles/7cc7d3c85c794033b590117321e97ccf` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:25.758071 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8abe568-9562-4ace-866d-61aaaa57ce2a None admin] RBAC: Authorizing `identity:create_grant(project_id=50dc269bfa7c47b5b3c652045ebe51ff, group_id=8d7f1df077e34dbe927f137abd17960c, role_id=7cc7d3c85c794033b590117321e97ccf)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:25.761369 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8abe568-9562-4ace-866d-61aaaa57ce2a None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:25.789512 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 209/412] 10.222.0.49 () {58 vars in 1442 bytes} [Tue Sep 27 09:39:25 2022] PUT /identity/v3/projects/50dc269bfa7c47b5b3c652045ebe51ff/groups/8d7f1df077e34dbe927f137abd17960c/roles/7cc7d3c85c794033b590117321e97ccf => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 09:39:25.792156 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a6ff1-a0d6-44b4-a528-8af4ebbedbb4 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:25.792644 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a6ff1-a0d6-44b4-a528-8af4ebbedbb4 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:25.793107 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a6ff1-a0d6-44b4-a528-8af4ebbedbb4 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:25.801263 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 210/413] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:25.804954 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884513fb-84d2-46c0-9cce-a77a867ccb0c None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:25.805423 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884513fb-84d2-46c0-9cce-a77a867ccb0c None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:25.805920 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884513fb-84d2-46c0-9cce-a77a867ccb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:25.839343 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-884513fb-84d2-46c0-9cce-a77a867ccb0c None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:25.841115 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-884513fb-84d2-46c0-9cce-a77a867ccb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:25.916713 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745abe6-e813-456b-bc2b-40e6009779cf None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:25.970161 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec2408-1a27-4b5f-ad17-a1607bc44052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:25.971342 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec2408-1a27-4b5f-ad17-a1607bc44052 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:25.971829 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec2408-1a27-4b5f-ad17-a1607bc44052 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:25.972293 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec2408-1a27-4b5f-ad17-a1607bc44052 None admin] PATH_INFO: `/v3/groups/316d8830d98648f6a377259b064f0ea6` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:25.973827 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec2408-1a27-4b5f-ad17-a1607bc44052 None admin] RBAC: Authorizing `identity:get_group(group_id=316d8830d98648f6a377259b064f0ea6)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:25.974038 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:25.975957 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec2408-1a27-4b5f-ad17-a1607bc44052 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:25.978984 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 204/414] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 27 09:39:25 2022] GET /identity/v3/groups/316d8830d98648f6a377259b064f0ea6 => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:39:25.981214 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5365475-16d8-48c8-bc9c-75e50f7c03f6 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:25.981715 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5365475-16d8-48c8-bc9c-75e50f7c03f6 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:25.982226 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5365475-16d8-48c8-bc9c-75e50f7c03f6 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:25.984177 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 205/415] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:25.986983 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5365475-16d8-48c8-bc9c-75e50f7c03f6 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:26.012332 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 211/416] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:39:26.012332 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625b0da-9530-4672-b212-d8e313b4ec5a None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:26.012332 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625b0da-9530-4672-b212-d8e313b4ec5a None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:26.012332 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625b0da-9530-4672-b212-d8e313b4ec5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:26.053703 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-c625b0da-9530-4672-b212-d8e313b4ec5a None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:26.059672 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-c625b0da-9530-4672-b212-d8e313b4ec5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:26.118401 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:26.206675 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 212/417] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:39:26.209260 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5365475-16d8-48c8-bc9c-75e50f7c03f6 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:26.285232 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff36947-4304-4955-9a42-396c8ab81d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:26.288244 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff36947-4304-4955-9a42-396c8ab81d5f None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:26.288997 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff36947-4304-4955-9a42-396c8ab81d5f None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:26.289743 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff36947-4304-4955-9a42-396c8ab81d5f None admin] PATH_INFO: `/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:26.292402 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff36947-4304-4955-9a42-396c8ab81d5f None admin] RBAC: Authorizing `identity:get_project(project_id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:26.295267 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff36947-4304-4955-9a42-396c8ab81d5f None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:26.298350 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 206/418] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:39:25 2022] GET /identity/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d => generated 302 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:26.308614 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625b0da-9530-4672-b212-d8e313b4ec5a None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:26.467702 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625b0da-9530-4672-b212-d8e313b4ec5a None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:26.517452 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:26.529576 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7c220-059d-408f-9d45-f609a6e3a81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:26.530314 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7c220-059d-408f-9d45-f609a6e3a81c None admin] REQUEST_METHOD: `PUT` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:26.530582 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7c220-059d-408f-9d45-f609a6e3a81c None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:26.530881 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7c220-059d-408f-9d45-f609a6e3a81c None admin] PATH_INFO: `/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d/groups/316d8830d98648f6a377259b064f0ea6/roles/3c0df08d0ed0435597a1d69ed45a49d4` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:26.533669 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7c220-059d-408f-9d45-f609a6e3a81c None admin] RBAC: Authorizing `identity:create_grant(project_id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d, group_id=316d8830d98648f6a377259b064f0ea6, role_id=3c0df08d0ed0435597a1d69ed45a49d4)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:26.535192 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7c220-059d-408f-9d45-f609a6e3a81c None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:26.561862 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 213/419] 10.222.0.49 () {58 vars in 1442 bytes} [Tue Sep 27 09:39:26 2022] PUT /identity/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d/groups/316d8830d98648f6a377259b064f0ea6/roles/3c0df08d0ed0435597a1d69ed45a49d4 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 09:39:26.620733 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff36947-4304-4955-9a42-396c8ab81d5f None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:26.851506 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff36947-4304-4955-9a42-396c8ab81d5f None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:26.868372 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7c220-059d-408f-9d45-f609a6e3a81c None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:26.904666 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:26.933875 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b9c8d-9bab-446b-9b9b-759e8b5ba397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:26.935562 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b9c8d-9bab-446b-9b9b-759e8b5ba397 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:26.936456 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b9c8d-9bab-446b-9b9b-759e8b5ba397 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:26.937214 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b9c8d-9bab-446b-9b9b-759e8b5ba397 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:26.976573 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b9c8d-9bab-446b-9b9b-759e8b5ba397 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:26.993410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-a95b9c8d-9bab-446b-9b9b-759e8b5ba397 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 09:39:26.993410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:26.993410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:26.993410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:26.993410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:26.993410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:26.993410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:26.993410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:26.993410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:26.993410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:26.993410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:26.993410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:26.993410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:26.993410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:26.993410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:26.993410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:26.995220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:26.995220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:26.995220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:26.995220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:26.995220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:26.995220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:26.995220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:26.995220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:26.995220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:26.995220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:26.995220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:26.995220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:26.995220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:26.995220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:26.995220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:26.995220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:26.996751 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:26.996751 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:26.996751 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:26.996751 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:26.996751 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:26.996751 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:26.996751 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:26.996751 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:26.996751 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:26.996751 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:26.996751 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 09:39:26.996751 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:27.001826 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 207/420] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 27 09:39:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:27.008107 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b9c8d-9bab-446b-9b9b-759e8b5ba397 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:27.109828 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7c220-059d-408f-9d45-f609a6e3a81c None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:27.163346 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3f2ee-4575-47c4-b3ee-ff9a7efbea83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:27.164051 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3f2ee-4575-47c4-b3ee-ff9a7efbea83 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:27.164334 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3f2ee-4575-47c4-b3ee-ff9a7efbea83 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:27.164591 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3f2ee-4575-47c4-b3ee-ff9a7efbea83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:27.180379 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3f2ee-4575-47c4-b3ee-ff9a7efbea83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:27.187227 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-5aa3f2ee-4575-47c4-b3ee-ff9a7efbea83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:39:27.187227 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:27.187227 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:27.187227 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:27.187227 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:27.187227 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:27.187227 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:27.187227 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:27.187227 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:27.187227 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:27.187227 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:27.187227 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:27.187227 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:27.187227 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:27.187227 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:27.187227 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:27.189104 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:27.189104 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:27.189104 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:27.189104 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:27.189104 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:27.189104 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:27.189104 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:27.189104 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:27.189104 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:27.189104 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:27.189104 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:27.189104 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:27.189104 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:27.189104 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:27.189104 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:27.189104 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:27.190655 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:27.190655 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:27.190655 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:27.190655 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:27.190655 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:27.190655 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:27.190655 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:27.190655 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:27.190655 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:27.190655 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:27.190655 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:39:27.190655 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:27.190655 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 214/421] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:39:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:27.190655 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4d81d-ed0c-41d5-9295-a54f078054b6 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:27.192089 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4d81d-ed0c-41d5-9295-a54f078054b6 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:27.192089 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4d81d-ed0c-41d5-9295-a54f078054b6 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:27.197579 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 215/422] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:27.202606 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4d81d-ed0c-41d5-9295-a54f078054b6 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:27.268139 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b9c8d-9bab-446b-9b9b-759e8b5ba397 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:27.273885 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:27.348159 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4d81d-ed0c-41d5-9295-a54f078054b6 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:27.363412 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c97f1-b1b8-48a2-ab6f-813d7117cd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:27.365799 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c97f1-b1b8-48a2-ab6f-813d7117cd32 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:27.366875 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c97f1-b1b8-48a2-ab6f-813d7117cd32 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:27.368374 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c97f1-b1b8-48a2-ab6f-813d7117cd32 None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:27.370270 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c97f1-b1b8-48a2-ab6f-813d7117cd32 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:27.371900 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c97f1-b1b8-48a2-ab6f-813d7117cd32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:27.373371 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c97f1-b1b8-48a2-ab6f-813d7117cd32 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:27.388678 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 208/423] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:39:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:27.390965 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef7888-739c-4718-a0f4-e6ffa8fa06f8 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:27.391160 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef7888-739c-4718-a0f4-e6ffa8fa06f8 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:27.391294 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef7888-739c-4718-a0f4-e6ffa8fa06f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:27.411715 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-63ef7888-739c-4718-a0f4-e6ffa8fa06f8 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:27.413041 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-63ef7888-739c-4718-a0f4-e6ffa8fa06f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:27.416030 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486cb1b-1503-4005-9209-b438eb2bac23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:27.419670 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486cb1b-1503-4005-9209-b438eb2bac23 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:27.420535 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486cb1b-1503-4005-9209-b438eb2bac23 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:27.421229 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486cb1b-1503-4005-9209-b438eb2bac23 None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:27.423669 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486cb1b-1503-4005-9209-b438eb2bac23 None admin] RBAC: Adding query filter params (name=member) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:27.424492 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486cb1b-1503-4005-9209-b438eb2bac23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:27.427852 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486cb1b-1503-4005-9209-b438eb2bac23 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:27.444921 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 216/424] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 27 09:39:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:27.445542 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486cb1b-1503-4005-9209-b438eb2bac23 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:27.484765 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:27.520454 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 209/425] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:39:27.521637 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef7888-739c-4718-a0f4-e6ffa8fa06f8 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:27.586283 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486cb1b-1503-4005-9209-b438eb2bac23 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:27.598061 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:27.632907 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114a585-9d6c-4055-9405-556fa707ff6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:27.633448 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114a585-9d6c-4055-9405-556fa707ff6b None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:27.633722 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114a585-9d6c-4055-9405-556fa707ff6b None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:27.633989 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114a585-9d6c-4055-9405-556fa707ff6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:27.642728 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef7888-739c-4718-a0f4-e6ffa8fa06f8 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:27.684275 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8e778-96e9-44cd-88a8-f5917c2068db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:27.685314 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8e778-96e9-44cd-88a8-f5917c2068db None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:27.685801 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8e778-96e9-44cd-88a8-f5917c2068db None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:27.686264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8e778-96e9-44cd-88a8-f5917c2068db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:27.725456 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114a585-9d6c-4055-9405-556fa707ff6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:27.727064 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114a585-9d6c-4055-9405-556fa707ff6b None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:27.742127 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:27.770813 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d8e778-96e9-44cd-88a8-f5917c2068db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:27.773049 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d8e778-96e9-44cd-88a8-f5917c2068db None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:27.857529 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 217/426] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:39:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:39:27.866990 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114a585-9d6c-4055-9405-556fa707ff6b None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:27.888899 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:27.894392 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 210/427] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:39:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:39:27.900691 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8e778-96e9-44cd-88a8-f5917c2068db None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:27.988589 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:28.014054 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8e778-96e9-44cd-88a8-f5917c2068db None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:28.054402 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fa2ce-681e-4309-878f-e326a753f2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:28.055573 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fa2ce-681e-4309-878f-e326a753f2d5 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:28.056057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fa2ce-681e-4309-878f-e326a753f2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:28.056741 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fa2ce-681e-4309-878f-e326a753f2d5 None admin] PATH_INFO: `/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:28.058367 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296fa2ce-681e-4309-878f-e326a753f2d5 None admin] RBAC: Authorizing `identity:get_project(project_id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:28.060891 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296fa2ce-681e-4309-878f-e326a753f2d5 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:28.063443 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 211/428] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:39:27 2022] GET /identity/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:28.070510 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fa2ce-681e-4309-878f-e326a753f2d5 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:28.186928 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fa2ce-681e-4309-878f-e326a753f2d5 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:28.226519 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535817df-d57e-4747-bf3c-e3f0baecc422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:28.227769 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535817df-d57e-4747-bf3c-e3f0baecc422 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:28.228256 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535817df-d57e-4747-bf3c-e3f0baecc422 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:28.228726 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535817df-d57e-4747-bf3c-e3f0baecc422 None admin] PATH_INFO: `/v3/groups/316d8830d98648f6a377259b064f0ea6` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:28.230121 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535817df-d57e-4747-bf3c-e3f0baecc422 None admin] RBAC: Authorizing `identity:get_group(group_id=316d8830d98648f6a377259b064f0ea6)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:28.231840 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535817df-d57e-4747-bf3c-e3f0baecc422 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:28.234211 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 212/429] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 27 09:39:28 2022] GET /identity/v3/groups/316d8830d98648f6a377259b064f0ea6 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:39:28.241009 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535817df-d57e-4747-bf3c-e3f0baecc422 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:28.242927 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114a585-9d6c-4055-9405-556fa707ff6b None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:28.275382 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:28.337306 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57c869-1f88-41e7-8ba7-277d886fc30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:28.338444 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57c869-1f88-41e7-8ba7-277d886fc30e None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:28.338954 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57c869-1f88-41e7-8ba7-277d886fc30e None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:28.339421 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57c869-1f88-41e7-8ba7-277d886fc30e None admin] PATH_INFO: `/v3/projects/31d28ae3268846449a1741369164016a` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:28.341346 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57c869-1f88-41e7-8ba7-277d886fc30e None admin] RBAC: Authorizing `identity:get_project(project_id=31d28ae3268846449a1741369164016a)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:28.344165 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57c869-1f88-41e7-8ba7-277d886fc30e None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:28.352041 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 218/430] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:39:27 2022] GET /identity/v3/projects/31d28ae3268846449a1741369164016a => generated 298 bytes in 482 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:28.352041 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57c869-1f88-41e7-8ba7-277d886fc30e None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:28.375502 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535817df-d57e-4747-bf3c-e3f0baecc422 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:28.431876 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c5ab8-72b2-401e-a687-61030ad066b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:28.432901 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c5ab8-72b2-401e-a687-61030ad066b8 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:28.433380 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c5ab8-72b2-401e-a687-61030ad066b8 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:28.433858 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c5ab8-72b2-401e-a687-61030ad066b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:28.435257 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c5ab8-72b2-401e-a687-61030ad066b8 None admin] RBAC: Adding query filter params (group.id=316d8830d98648f6a377259b064f0ea6, role.id=378cb7fb6a4e4e5e89ab9a0ecb09d86b, scope.project.id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:28.435870 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c5ab8-72b2-401e-a687-61030ad066b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:28.438704 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c5ab8-72b2-401e-a687-61030ad066b8 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:28.455713 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 213/431] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Sep 27 09:39:28 2022] GET /identity/v3/role_assignments?group.id=316d8830d98648f6a377259b064f0ea6&scope.project.id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d&role.id=378cb7fb6a4e4e5e89ab9a0ecb09d86b => generated 611 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:39:28.455713 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c5ab8-72b2-401e-a687-61030ad066b8 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:28.510341 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:28.560022 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57c869-1f88-41e7-8ba7-277d886fc30e None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:28.654674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deefd18-bb2b-4417-8dcc-3946b1258cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:28.655816 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deefd18-bb2b-4417-8dcc-3946b1258cb8 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:28.656295 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deefd18-bb2b-4417-8dcc-3946b1258cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:28.656771 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deefd18-bb2b-4417-8dcc-3946b1258cb8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:28.693194 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deefd18-bb2b-4417-8dcc-3946b1258cb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:28.713284 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-4deefd18-bb2b-4417-8dcc-3946b1258cb8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:39:28.713284 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:28.713284 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:28.713284 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:28.713284 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:28.713284 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:28.713284 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:28.713284 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:28.713284 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:28.713284 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:28.713284 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:28.713284 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:28.713284 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:28.713284 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:28.713284 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:28.713284 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:28.714318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:28.714318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:28.714318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:28.714318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:28.714318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:28.714318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:28.714318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:28.714318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:28.714318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:28.714318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:28.714318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:28.714318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:28.714318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:28.714318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:28.714318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:28.714318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:28.715169 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:28.715169 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:28.715169 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:28.715169 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:28.715169 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:28.715169 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:28.715169 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:28.715169 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:28.715169 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:28.715169 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:28.715169 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 09:39:28.715169 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:28.715774 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 219/432] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:39:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:28.725359 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deefd18-bb2b-4417-8dcc-3946b1258cb8 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:28.770075 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:28.849921 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c5ab8-72b2-401e-a687-61030ad066b8 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:28.942934 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f72be5-135c-4771-ae2b-d33685116e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:28.945330 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f72be5-135c-4771-ae2b-d33685116e97 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:28.945760 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f72be5-135c-4771-ae2b-d33685116e97 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:28.946249 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f72be5-135c-4771-ae2b-d33685116e97 None admin] PATH_INFO: `/v3/groups/316d8830d98648f6a377259b064f0ea6` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:28.951715 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f72be5-135c-4771-ae2b-d33685116e97 None admin] RBAC: Authorizing `identity:get_group(group_id=316d8830d98648f6a377259b064f0ea6)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:28.955026 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f72be5-135c-4771-ae2b-d33685116e97 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:28.960568 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 214/433] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 27 09:39:28 2022] GET /identity/v3/groups/316d8830d98648f6a377259b064f0ea6 => generated 226 bytes in 509 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:28.968615 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f72be5-135c-4771-ae2b-d33685116e97 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:29.004025 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deefd18-bb2b-4417-8dcc-3946b1258cb8 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:29.066577 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a0279-130a-4342-b370-afb28a6f19b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:29.067663 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a0279-130a-4342-b370-afb28a6f19b1 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:29.068120 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a0279-130a-4342-b370-afb28a6f19b1 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:29.068545 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a0279-130a-4342-b370-afb28a6f19b1 None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:29.069401 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a0279-130a-4342-b370-afb28a6f19b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:29.070475 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a0279-130a-4342-b370-afb28a6f19b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:29.072178 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a0279-130a-4342-b370-afb28a6f19b1 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:29.077057 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:29.092791 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 220/434] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 27 09:39:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:29.095061 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a0279-130a-4342-b370-afb28a6f19b1 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:29.156337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f72be5-135c-4771-ae2b-d33685116e97 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:29.197977 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f7234-2337-4b22-9c91-0d1b837a2ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:29.199141 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f7234-2337-4b22-9c91-0d1b837a2ae3 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:29.199690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f7234-2337-4b22-9c91-0d1b837a2ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:29.200157 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f7234-2337-4b22-9c91-0d1b837a2ae3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:29.201102 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f7234-2337-4b22-9c91-0d1b837a2ae3 None admin] RBAC: Adding query filter params (group.id=316d8830d98648f6a377259b064f0ea6, role.id=3c0df08d0ed0435597a1d69ed45a49d4, scope.project.id=31d28ae3268846449a1741369164016a) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:29.201623 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f7234-2337-4b22-9c91-0d1b837a2ae3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:29.203332 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f7234-2337-4b22-9c91-0d1b837a2ae3 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:29.215244 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 215/435] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Sep 27 09:39:28 2022] GET /identity/v3/role_assignments?group.id=316d8830d98648f6a377259b064f0ea6&scope.project.id=31d28ae3268846449a1741369164016a&role.id=3c0df08d0ed0435597a1d69ed45a49d4 => generated 611 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:29.330172 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a0279-130a-4342-b370-afb28a6f19b1 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:29.407584 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03038683-0aff-4960-828d-03279e5d1f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:29.408670 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03038683-0aff-4960-828d-03279e5d1f3e None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:29.409263 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03038683-0aff-4960-828d-03279e5d1f3e None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:29.409757 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03038683-0aff-4960-828d-03279e5d1f3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:29.471791 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6590f7f-996d-46ec-83f8-af2b20ee1495 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:29.472589 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6590f7f-996d-46ec-83f8-af2b20ee1495 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:29.472589 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6590f7f-996d-46ec-83f8-af2b20ee1495 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:29.474158 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 216/436] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:39:29.482311 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4cee2-ec9d-4d75-a012-224dcde9f5a5 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:29.482843 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4cee2-ec9d-4d75-a012-224dcde9f5a5 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:29.483289 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4cee2-ec9d-4d75-a012-224dcde9f5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:29.509216 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-84c4cee2-ec9d-4d75-a012-224dcde9f5a5 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:29.510731 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-84c4cee2-ec9d-4d75-a012-224dcde9f5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:29.513502 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:29.551926 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:29.558578 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03038683-0aff-4960-828d-03279e5d1f3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:29.558578 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03038683-0aff-4960-828d-03279e5d1f3e None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:29.639327 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 217/437] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 09:39:29.701349 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 221/438] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:39:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:39:29.710975 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4cee2-ec9d-4d75-a012-224dcde9f5a5 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:29.889876 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4cee2-ec9d-4d75-a012-224dcde9f5a5 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:29.955473 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03038683-0aff-4960-828d-03279e5d1f3e None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:29.958703 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd68b2-f9aa-4351-9669-9be2a4197f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:29.962045 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd68b2-f9aa-4351-9669-9be2a4197f91 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:29.962508 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd68b2-f9aa-4351-9669-9be2a4197f91 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:29.963022 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd68b2-f9aa-4351-9669-9be2a4197f91 None admin] PATH_INFO: `/v3/projects/31d28ae3268846449a1741369164016a` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:29.965181 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd68b2-f9aa-4351-9669-9be2a4197f91 None admin] RBAC: Authorizing `identity:get_project(project_id=31d28ae3268846449a1741369164016a)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:29.969255 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd68b2-f9aa-4351-9669-9be2a4197f91 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:29.972994 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 218/439] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:39:29 2022] GET /identity/v3/projects/31d28ae3268846449a1741369164016a => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:29.983142 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd68b2-f9aa-4351-9669-9be2a4197f91 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:29.999325 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:30.071876 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:30.077805 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03038683-0aff-4960-828d-03279e5d1f3e None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:30.130569 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a3a1a-b37f-4b57-81bf-d891c732ef57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:30.132068 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a3a1a-b37f-4b57-81bf-d891c732ef57 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:30.132248 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a3a1a-b37f-4b57-81bf-d891c732ef57 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:30.132711 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a3a1a-b37f-4b57-81bf-d891c732ef57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:30.146282 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd68b2-f9aa-4351-9669-9be2a4197f91 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:30.152888 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a3a1a-b37f-4b57-81bf-d891c732ef57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:30.163620 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-6c0a3a1a-b37f-4b57-81bf-d891c732ef57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:39:30.163620 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:30.163620 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:30.163620 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:30.163620 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:30.163620 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:30.163620 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:30.163620 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:30.163620 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:30.163620 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:30.163620 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:30.163620 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:30.163620 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:30.163620 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:30.163620 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:30.163620 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:30.164591 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:30.164591 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:30.164591 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:30.164591 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:30.164591 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:30.164591 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:30.164591 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:30.164591 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:30.164591 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:30.164591 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:30.164591 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:30.164591 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:30.164591 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:30.164591 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:30.164591 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:30.164591 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:30.165436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:30.165436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:30.165436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:30.165436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:30.165436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:30.165436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:30.165436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:30.165436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:30.165436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:30.165436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:30.165436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:39:30.165436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:30.166060 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 222/440] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 27 09:39:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 09:39:30.175301 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a3a1a-b37f-4b57-81bf-d891c732ef57 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:30.202553 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0b5fb-075e-4514-b312-5b9de7b602c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:30.203621 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0b5fb-075e-4514-b312-5b9de7b602c5 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:30.204066 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0b5fb-075e-4514-b312-5b9de7b602c5 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:30.204485 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0b5fb-075e-4514-b312-5b9de7b602c5 None admin] PATH_INFO: `/v3/groups/316d8830d98648f6a377259b064f0ea6` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:30.206555 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a0b5fb-075e-4514-b312-5b9de7b602c5 None admin] RBAC: Authorizing `identity:get_group(group_id=316d8830d98648f6a377259b064f0ea6)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:30.209461 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a0b5fb-075e-4514-b312-5b9de7b602c5 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:30.214045 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 219/441] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 27 09:39:29 2022] GET /identity/v3/groups/316d8830d98648f6a377259b064f0ea6 => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:30.222479 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0b5fb-075e-4514-b312-5b9de7b602c5 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:30.334236 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:30.338287 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a3a1a-b37f-4b57-81bf-d891c732ef57 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:30.365037 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0b5fb-075e-4514-b312-5b9de7b602c5 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:30.382875 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1cfe5-4304-40e8-ac8d-5e49514cdef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:30.383538 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1cfe5-4304-40e8-ac8d-5e49514cdef9 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:30.383811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1cfe5-4304-40e8-ac8d-5e49514cdef9 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:30.384073 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1cfe5-4304-40e8-ac8d-5e49514cdef9 None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:30.384774 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1cfe5-4304-40e8-ac8d-5e49514cdef9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:30.385074 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1cfe5-4304-40e8-ac8d-5e49514cdef9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:30.386546 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1cfe5-4304-40e8-ac8d-5e49514cdef9 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:30.397284 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 223/442] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:39:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:39:30.403242 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1cfe5-4304-40e8-ac8d-5e49514cdef9 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:30.417050 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c0091-1e21-448b-b77f-e474e480bcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:30.417681 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c0091-1e21-448b-b77f-e474e480bcf8 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:30.417955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c0091-1e21-448b-b77f-e474e480bcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:30.418221 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c0091-1e21-448b-b77f-e474e480bcf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:30.418990 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c0091-1e21-448b-b77f-e474e480bcf8 None admin] RBAC: Adding query filter params (group.id=316d8830d98648f6a377259b064f0ea6, role.id=378cb7fb6a4e4e5e89ab9a0ecb09d86b, scope.project.id=31d28ae3268846449a1741369164016a) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:30.419298 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c0091-1e21-448b-b77f-e474e480bcf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:30.420751 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c0091-1e21-448b-b77f-e474e480bcf8 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:30.427863 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 220/443] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Sep 27 09:39:30 2022] GET /identity/v3/role_assignments?group.id=316d8830d98648f6a377259b064f0ea6&scope.project.id=31d28ae3268846449a1741369164016a&role.id=378cb7fb6a4e4e5e89ab9a0ecb09d86b => generated 611 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:30.447079 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:30.558027 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1cfe5-4304-40e8-ac8d-5e49514cdef9 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:30.609774 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140530fa-30f2-407a-8aae-28fa5f5d2f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:30.610586 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140530fa-30f2-407a-8aae-28fa5f5d2f46 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:30.611027 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140530fa-30f2-407a-8aae-28fa5f5d2f46 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:30.611418 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140530fa-30f2-407a-8aae-28fa5f5d2f46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:30.701326 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140530fa-30f2-407a-8aae-28fa5f5d2f46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:30.703170 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140530fa-30f2-407a-8aae-28fa5f5d2f46 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:30.730583 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:30.843287 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 224/444] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:39:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 27 09:39:30.850136 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c0091-1e21-448b-b77f-e474e480bcf8 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:31.010407 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c0091-1e21-448b-b77f-e474e480bcf8 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:31.051138 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690199f4-6985-4eff-92ca-d1383eae8267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:31.051769 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690199f4-6985-4eff-92ca-d1383eae8267 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:31.052041 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690199f4-6985-4eff-92ca-d1383eae8267 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:31.052382 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690199f4-6985-4eff-92ca-d1383eae8267 None admin] PATH_INFO: `/v3/projects/50dc269bfa7c47b5b3c652045ebe51ff` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:31.053582 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690199f4-6985-4eff-92ca-d1383eae8267 None admin] RBAC: Authorizing `identity:get_project(project_id=50dc269bfa7c47b5b3c652045ebe51ff)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:31.055066 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690199f4-6985-4eff-92ca-d1383eae8267 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:31.056959 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 221/445] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:39:30 2022] GET /identity/v3/projects/50dc269bfa7c47b5b3c652045ebe51ff => generated 344 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:31.062328 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690199f4-6985-4eff-92ca-d1383eae8267 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:31.062796 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3866bb-1023-446d-9fec-8ca1b7a20a9e None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:31.063206 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3866bb-1023-446d-9fec-8ca1b7a20a9e None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:31.063675 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3866bb-1023-446d-9fec-8ca1b7a20a9e None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:31.066149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 225/446] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:31.072046 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b48ef-85bd-4a67-acfd-79df6de35d1e None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:31.073013 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b48ef-85bd-4a67-acfd-79df6de35d1e None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:31.073283 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b48ef-85bd-4a67-acfd-79df6de35d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:31.073761 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:31.101895 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-854b48ef-85bd-4a67-acfd-79df6de35d1e None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:31.104392 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-854b48ef-85bd-4a67-acfd-79df6de35d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:31.212533 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 226/447] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 09:39:31.244984 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690199f4-6985-4eff-92ca-d1383eae8267 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:31.293961 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750929f-a067-4f8a-820e-4ded546b03ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:31.294985 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750929f-a067-4f8a-820e-4ded546b03ab None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:31.295471 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750929f-a067-4f8a-820e-4ded546b03ab None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:31.295954 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750929f-a067-4f8a-820e-4ded546b03ab None admin] PATH_INFO: `/v3/groups/8d7f1df077e34dbe927f137abd17960c` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:31.297710 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750929f-a067-4f8a-820e-4ded546b03ab None admin] RBAC: Authorizing `identity:get_group(group_id=8d7f1df077e34dbe927f137abd17960c)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:31.299341 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750929f-a067-4f8a-820e-4ded546b03ab None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:31.301962 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 222/448] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 27 09:39:31 2022] GET /identity/v3/groups/8d7f1df077e34dbe927f137abd17960c => generated 229 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:39:31.308982 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b48ef-85bd-4a67-acfd-79df6de35d1e None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:31.393943 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:31.477550 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b48ef-85bd-4a67-acfd-79df6de35d1e None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:31.545273 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288b35d-8543-4a8a-b914-e793422ecc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:31.546228 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288b35d-8543-4a8a-b914-e793422ecc95 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:31.546699 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288b35d-8543-4a8a-b914-e793422ecc95 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:31.547218 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288b35d-8543-4a8a-b914-e793422ecc95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:31.547572 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750929f-a067-4f8a-820e-4ded546b03ab None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:31.548596 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288b35d-8543-4a8a-b914-e793422ecc95 None admin] RBAC: Adding query filter params (group.id=8d7f1df077e34dbe927f137abd17960c, role.id=7cc7d3c85c794033b590117321e97ccf, scope.project.id=50dc269bfa7c47b5b3c652045ebe51ff) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:31.549145 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288b35d-8543-4a8a-b914-e793422ecc95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:31.551972 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288b35d-8543-4a8a-b914-e793422ecc95 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:31.566171 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 227/449] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Sep 27 09:39:31 2022] GET /identity/v3/role_assignments?group.id=8d7f1df077e34dbe927f137abd17960c&scope.project.id=50dc269bfa7c47b5b3c652045ebe51ff&role.id=7cc7d3c85c794033b590117321e97ccf => generated 611 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:39:31.639890 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:31.673446 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750929f-a067-4f8a-820e-4ded546b03ab None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:31.716037 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8d42e-b50b-481e-9ce2-1b871f5a7c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:31.716838 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8d42e-b50b-481e-9ce2-1b871f5a7c2c None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:31.717227 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8d42e-b50b-481e-9ce2-1b871f5a7c2c None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:31.717614 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8d42e-b50b-481e-9ce2-1b871f5a7c2c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:31.732874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8d42e-b50b-481e-9ce2-1b871f5a7c2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:31.738564 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-bbd8d42e-b50b-481e-9ce2-1b871f5a7c2c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 09:39:31.738564 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:31.738564 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:31.738564 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:31.738564 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:31.738564 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:31.738564 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:31.738564 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:31.738564 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:31.738564 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:31.738564 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:31.738564 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:31.738564 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:31.738564 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:31.738564 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:31.738564 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:31.740611 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:31.740611 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:31.740611 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:31.740611 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:31.740611 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:31.740611 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:31.740611 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:31.740611 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:31.740611 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:31.740611 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:31.740611 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:31.740611 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:31.740611 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:31.740611 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:31.740611 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:31.740611 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:31.741600 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:31.741600 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:31.741600 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:31.741600 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:31.741600 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:31.741600 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:31.741600 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:31.741600 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:31.741600 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:31.741600 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:31.741600 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 09:39:31.741600 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:31.741600 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 223/450] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 27 09:39:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:31.749849 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288b35d-8543-4a8a-b914-e793422ecc95 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:31.879576 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288b35d-8543-4a8a-b914-e793422ecc95 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:31.895226 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:31.916999 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1712f6e-5c35-4685-a707-8de2960ea19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:31.917641 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1712f6e-5c35-4685-a707-8de2960ea19e None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:31.917916 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1712f6e-5c35-4685-a707-8de2960ea19e None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:31.918184 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1712f6e-5c35-4685-a707-8de2960ea19e None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:31.918897 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1712f6e-5c35-4685-a707-8de2960ea19e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:31.919194 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1712f6e-5c35-4685-a707-8de2960ea19e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:31.920579 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1712f6e-5c35-4685-a707-8de2960ea19e None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:31.929633 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 228/451] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:39:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:39:31.936059 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8d42e-b50b-481e-9ce2-1b871f5a7c2c None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:32.068461 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8d42e-b50b-481e-9ce2-1b871f5a7c2c None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:32.110274 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a44cd-118c-40f0-9fd1-98beb3d42e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:32.110924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a44cd-118c-40f0-9fd1-98beb3d42e55 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:32.111202 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a44cd-118c-40f0-9fd1-98beb3d42e55 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:32.111472 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a44cd-118c-40f0-9fd1-98beb3d42e55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:32.114502 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:32.185925 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a44cd-118c-40f0-9fd1-98beb3d42e55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:32.187435 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a44cd-118c-40f0-9fd1-98beb3d42e55 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:32.293412 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 224/452] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:39:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:39:32.299572 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1712f6e-5c35-4685-a707-8de2960ea19e None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:32.447938 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1712f6e-5c35-4685-a707-8de2960ea19e None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:32.488615 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bf3fd-5e70-472c-86fa-d8c23550a942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:32.489269 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bf3fd-5e70-472c-86fa-d8c23550a942 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:32.489546 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bf3fd-5e70-472c-86fa-d8c23550a942 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:32.489894 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bf3fd-5e70-472c-86fa-d8c23550a942 None admin] PATH_INFO: `/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:32.491137 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450bf3fd-5e70-472c-86fa-d8c23550a942 None admin] RBAC: Authorizing `identity:get_project(project_id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:32.492603 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450bf3fd-5e70-472c-86fa-d8c23550a942 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:32.494289 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 229/453] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Sep 27 09:39:32 2022] GET /identity/v3/projects/bc8cb3d4017b4b47b6bcd1b4ce17ea0d => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:32.503396 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a44cd-118c-40f0-9fd1-98beb3d42e55 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:32.558500 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:32.633433 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a44cd-118c-40f0-9fd1-98beb3d42e55 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:32.670508 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1dcba1-916e-4803-b092-ad28f6c48d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:32.671184 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dcba1-916e-4803-b092-ad28f6c48d94 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:32.671462 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dcba1-916e-4803-b092-ad28f6c48d94 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:32.671732 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dcba1-916e-4803-b092-ad28f6c48d94 None admin] PATH_INFO: `/v3/groups/316d8830d98648f6a377259b064f0ea6` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:32.672909 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1dcba1-916e-4803-b092-ad28f6c48d94 None admin] RBAC: Authorizing `identity:get_group(group_id=316d8830d98648f6a377259b064f0ea6)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:32.674374 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1dcba1-916e-4803-b092-ad28f6c48d94 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:32.676010 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 225/454] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Sep 27 09:39:32 2022] GET /identity/v3/groups/316d8830d98648f6a377259b064f0ea6 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:32.682414 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bf3fd-5e70-472c-86fa-d8c23550a942 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:32.736178 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:32.795338 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bf3fd-5e70-472c-86fa-d8c23550a942 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:32.836896 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b24de-5716-4496-bda6-f9265aa282c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:32.837521 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b24de-5716-4496-bda6-f9265aa282c8 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:32.837802 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b24de-5716-4496-bda6-f9265aa282c8 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:32.838074 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b24de-5716-4496-bda6-f9265aa282c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:32.838813 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b24de-5716-4496-bda6-f9265aa282c8 None admin] RBAC: Adding query filter params (group.id=316d8830d98648f6a377259b064f0ea6, role.id=3c0df08d0ed0435597a1d69ed45a49d4, scope.project.id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:32.839143 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b24de-5716-4496-bda6-f9265aa282c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:32.840616 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b24de-5716-4496-bda6-f9265aa282c8 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:32.847413 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 230/455] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Sep 27 09:39:32 2022] GET /identity/v3/role_assignments?group.id=316d8830d98648f6a377259b064f0ea6&scope.project.id=bc8cb3d4017b4b47b6bcd1b4ce17ea0d&role.id=3c0df08d0ed0435597a1d69ed45a49d4 => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:36.067981 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999354c4-0bb3-4b1d-8a57-d418c55fb263 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:36.069035 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999354c4-0bb3-4b1d-8a57-d418c55fb263 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:36.069525 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999354c4-0bb3-4b1d-8a57-d418c55fb263 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:36.071594 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 226/456] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:36.077152 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c56801-eb92-4351-86ad-34daa49917ae None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:36.078012 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c56801-eb92-4351-86ad-34daa49917ae None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:36.078422 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c56801-eb92-4351-86ad-34daa49917ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:36.100597 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-86c56801-eb92-4351-86ad-34daa49917ae None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:36.101888 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-86c56801-eb92-4351-86ad-34daa49917ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:36.134037 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146082b0-f153-409f-92d0-d0b09b45511a None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:36.134372 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146082b0-f153-409f-92d0-d0b09b45511a None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:36.134572 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146082b0-f153-409f-92d0-d0b09b45511a None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:36.137155 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 227/457] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:36.143587 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3b83a-c000-4942-b951-a4ecef285bb1 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:36.144246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3b83a-c000-4942-b951-a4ecef285bb1 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:36.144721 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3b83a-c000-4942-b951-a4ecef285bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:36.168415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-2be3b83a-c000-4942-b951-a4ecef285bb1 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:36.171395 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-2be3b83a-c000-4942-b951-a4ecef285bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:36.212459 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 231/458] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 09:39:36.310255 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 228/459] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 09:39:36.447004 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af771f4-92da-4581-bdb2-b135946296e9 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:36.447246 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af771f4-92da-4581-bdb2-b135946296e9 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:36.447579 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af771f4-92da-4581-bdb2-b135946296e9 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:36.449280 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 232/460] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:36.455762 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f6c7f-b87f-44dd-820e-360440dd5324 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:36.456160 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f6c7f-b87f-44dd-820e-360440dd5324 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:36.456396 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f6c7f-b87f-44dd-820e-360440dd5324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:36.481177 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-876f6c7f-b87f-44dd-820e-360440dd5324 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:36.482883 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-876f6c7f-b87f-44dd-820e-360440dd5324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:36.520610 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:36.566608 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af771f4-92da-4581-bdb2-b135946296e9 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:36.589589 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 229/461] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:39:36.591386 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b247568-2037-48aa-a658-4f8c6897fc20 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:36.591790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b247568-2037-48aa-a658-4f8c6897fc20 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:36.592211 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b247568-2037-48aa-a658-4f8c6897fc20 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:36.595084 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 230/462] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:36.602837 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b8ae2-7e57-40bd-a958-595d5354f030 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:36.603254 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b8ae2-7e57-40bd-a958-595d5354f030 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:36.603653 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b8ae2-7e57-40bd-a958-595d5354f030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:36.633760 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-b50b8ae2-7e57-40bd-a958-595d5354f030 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:36.635965 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-b50b8ae2-7e57-40bd-a958-595d5354f030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:36.687212 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:36.717001 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af771f4-92da-4581-bdb2-b135946296e9 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:36.721657 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 231/463] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 09:39:36.722910 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b8ae2-7e57-40bd-a958-595d5354f030 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:36.767823 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cdc77-3457-461a-b0f9-47f083fe9117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:36.768476 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cdc77-3457-461a-b0f9-47f083fe9117 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:36.768751 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cdc77-3457-461a-b0f9-47f083fe9117 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:36.769016 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cdc77-3457-461a-b0f9-47f083fe9117 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:36.789377 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0cdc77-3457-461a-b0f9-47f083fe9117 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:36.790904 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0cdc77-3457-461a-b0f9-47f083fe9117 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:36.813313 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-3b0cdc77-3457-461a-b0f9-47f083fe9117 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:36.813313 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:36.813313 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:36.813313 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:36.813313 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:36.813313 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:36.813313 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:36.813313 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:36.813313 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:36.813313 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:36.813313 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:36.813313 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:36.813313 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:39:36.813313 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:39:36.813313 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:39:36.813313 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:39:36.814294 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:36.814294 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:36.814294 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:36.814294 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:36.814294 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:36.814294 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:36.814294 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:36.814294 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:36.814294 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:36.814294 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:36.814294 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:36.814294 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:36.814294 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:36.814294 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:36.814294 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:36.814294 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:36.814294 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:39:36.815398 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:39:36.815398 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:36.815398 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:36.818918 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 233/464] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:36.821676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cdc77-3457-461a-b0f9-47f083fe9117 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:36.848677 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:36.860939 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b8ae2-7e57-40bd-a958-595d5354f030 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:36.924185 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb9023-c804-4cb3-bd25-19341b8258eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:36.924825 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb9023-c804-4cb3-bd25-19341b8258eb None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:36.925102 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb9023-c804-4cb3-bd25-19341b8258eb None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:36.925368 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb9023-c804-4cb3-bd25-19341b8258eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:36.937072 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb9023-c804-4cb3-bd25-19341b8258eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:36.938564 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb9023-c804-4cb3-bd25-19341b8258eb None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:36.954684 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-0ecb9023-c804-4cb3-bd25-19341b8258eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:36.954684 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:36.954684 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:36.954684 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:36.954684 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:36.954684 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:36.954684 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:36.954684 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:36.954684 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:36.954684 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:36.954684 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:36.954684 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:36.954684 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:39:36.954684 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:39:36.954684 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:39:36.954684 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:39:36.955672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:36.955672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:36.955672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:36.955672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:36.955672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:36.955672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:36.955672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:36.955672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:36.955672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:36.955672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:36.955672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:36.955672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:36.955672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:36.955672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:36.955672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:36.955672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:36.955672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:39:36.956505 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:39:36.956505 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:36.956505 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:36.956505 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 232/465] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:36.956722 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb9023-c804-4cb3-bd25-19341b8258eb None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:36.957792 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:36.981987 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cdc77-3457-461a-b0f9-47f083fe9117 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:37.023787 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5d196-6bec-4c77-a4af-80befeb67885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:37.024432 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5d196-6bec-4c77-a4af-80befeb67885 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:37.024706 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5d196-6bec-4c77-a4af-80befeb67885 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:37.024978 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5d196-6bec-4c77-a4af-80befeb67885 None admin] PATH_INFO: `/v3/domains` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:37.025630 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5d196-6bec-4c77-a4af-80befeb67885 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:37.025926 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5d196-6bec-4c77-a4af-80befeb67885 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:37.027763 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5d196-6bec-4c77-a4af-80befeb67885 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:37.041930 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 234/466] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:39:37.042987 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5d196-6bec-4c77-a4af-80befeb67885 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:37.093432 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb9023-c804-4cb3-bd25-19341b8258eb None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:37.131064 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be91d81-bd9b-4278-8154-f74af19361cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:37.131716 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be91d81-bd9b-4278-8154-f74af19361cd None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:37.131995 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be91d81-bd9b-4278-8154-f74af19361cd None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:37.132270 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be91d81-bd9b-4278-8154-f74af19361cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:37.144129 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be91d81-bd9b-4278-8154-f74af19361cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:37.145620 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be91d81-bd9b-4278-8154-f74af19361cd None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:37.148719 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:37.160051 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5d196-6bec-4c77-a4af-80befeb67885 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:37.162429 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-3be91d81-bd9b-4278-8154-f74af19361cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:37.162429 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:37.162429 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:37.162429 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:37.162429 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:37.162429 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:37.162429 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:37.162429 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:37.162429 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:37.162429 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:37.162429 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:37.162429 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:37.162429 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:39:37.162429 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:39:37.162429 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:39:37.162429 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:39:37.163500 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:37.163500 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:37.163500 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:37.163500 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:37.163500 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:37.163500 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:37.163500 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:37.163500 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:37.163500 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:37.163500 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:37.163500 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:37.163500 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:37.163500 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:37.163500 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:37.163500 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:37.163500 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:37.163500 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:39:37.164594 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:39:37.164594 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:37.164594 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:37.164594 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 233/467] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:37.164594 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be91d81-bd9b-4278-8154-f74af19361cd None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:37.207844 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70ca8f-e545-44a8-97d3-a414f9924feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:37.208539 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70ca8f-e545-44a8-97d3-a414f9924feb None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:37.208814 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70ca8f-e545-44a8-97d3-a414f9924feb None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:37.209092 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70ca8f-e545-44a8-97d3-a414f9924feb None admin] PATH_INFO: `/v3/domains` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:37.209748 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70ca8f-e545-44a8-97d3-a414f9924feb None admin] RBAC: Adding query filter params (name=Default) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:37.210049 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70ca8f-e545-44a8-97d3-a414f9924feb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:37.211517 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70ca8f-e545-44a8-97d3-a414f9924feb None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:37.223648 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 235/468] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:37.224623 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70ca8f-e545-44a8-97d3-a414f9924feb None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:37.237656 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:37.281145 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be91d81-bd9b-4278-8154-f74af19361cd None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:37.329077 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483de45f-b026-4b42-aa63-e6021e0a5be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:37.329724 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483de45f-b026-4b42-aa63-e6021e0a5be6 None admin] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:37.329970 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483de45f-b026-4b42-aa63-e6021e0a5be6 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:37.330239 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483de45f-b026-4b42-aa63-e6021e0a5be6 None admin] PATH_INFO: `/v3/users` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:37.330936 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483de45f-b026-4b42-aa63-e6021e0a5be6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:37.332436 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483de45f-b026-4b42-aa63-e6021e0a5be6 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:37.353172 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70ca8f-e545-44a8-97d3-a414f9924feb None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:37.359183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 234/469] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 27 09:39:37 2022] POST /identity/v3/users => generated 246 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:39:37.360588 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483de45f-b026-4b42-aa63-e6021e0a5be6 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:37.405480 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e5ee4-c448-4697-b1ec-b122b38756dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:37.406973 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e5ee4-c448-4697-b1ec-b122b38756dd None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:37.407483 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e5ee4-c448-4697-b1ec-b122b38756dd None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:37.407883 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e5ee4-c448-4697-b1ec-b122b38756dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:37.425821 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e5ee4-c448-4697-b1ec-b122b38756dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:37.428423 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e5ee4-c448-4697-b1ec-b122b38756dd None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:37.447966 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:37.454020 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-0a9e5ee4-c448-4697-b1ec-b122b38756dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:37.454020 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:37.454020 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:37.454020 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:37.454020 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:37.454020 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:37.454020 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:37.454020 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:37.454020 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:37.454020 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:37.454020 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:37.454020 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:37.454020 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:39:37.454020 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:39:37.454020 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:39:37.454020 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:39:37.455151 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:37.455151 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:37.455151 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:37.455151 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:37.455151 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:37.455151 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:37.455151 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:37.455151 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:37.455151 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:37.455151 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:37.455151 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:37.455151 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:37.455151 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:37.455151 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:37.455151 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:37.455151 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:37.455151 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:39:37.456507 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:39:37.456507 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:37.456507 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:37.456507 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 236/470] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:37.456966 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e5ee4-c448-4697-b1ec-b122b38756dd None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:37.525552 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483de45f-b026-4b42-aa63-e6021e0a5be6 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:37.573403 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:37.589856 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6527649-95fb-47b6-addd-752b15193b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:37.590825 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6527649-95fb-47b6-addd-752b15193b0d None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:37.591223 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6527649-95fb-47b6-addd-752b15193b0d None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:37.591644 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6527649-95fb-47b6-addd-752b15193b0d None admin] PATH_INFO: `/v3/domains` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:37.593447 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6527649-95fb-47b6-addd-752b15193b0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:37.593447 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6527649-95fb-47b6-addd-752b15193b0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:37.595464 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6527649-95fb-47b6-addd-752b15193b0d None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:37.627658 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 235/471] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:37.633484 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6527649-95fb-47b6-addd-752b15193b0d None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:37.637854 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e5ee4-c448-4697-b1ec-b122b38756dd None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:37.686118 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273d0fa-e9e5-4b60-aed5-5270b9d5fb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:37.687923 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273d0fa-e9e5-4b60-aed5-5270b9d5fb98 None admin] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:37.687923 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273d0fa-e9e5-4b60-aed5-5270b9d5fb98 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:37.687923 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273d0fa-e9e5-4b60-aed5-5270b9d5fb98 None admin] PATH_INFO: `/v3/users` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:37.688504 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c273d0fa-e9e5-4b60-aed5-5270b9d5fb98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:37.690521 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c273d0fa-e9e5-4b60-aed5-5270b9d5fb98 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:37.723701 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 237/472] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 27 09:39:37 2022] POST /identity/v3/users => generated 248 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:39:37.726588 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273d0fa-e9e5-4b60-aed5-5270b9d5fb98 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:37.831950 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6527649-95fb-47b6-addd-752b15193b0d None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:37.859720 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:37.919799 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25a531-1e20-4a9a-aa73-9072f45220c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:37.922268 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25a531-1e20-4a9a-aa73-9072f45220c7 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:37.923320 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25a531-1e20-4a9a-aa73-9072f45220c7 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:37.923936 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25a531-1e20-4a9a-aa73-9072f45220c7 None admin] PATH_INFO: `/v3/domains` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:37.925070 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273d0fa-e9e5-4b60-aed5-5270b9d5fb98 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:37.925399 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25a531-1e20-4a9a-aa73-9072f45220c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:37.926060 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25a531-1e20-4a9a-aa73-9072f45220c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:37.930823 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25a531-1e20-4a9a-aa73-9072f45220c7 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:37.953661 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:37.960482 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 236/473] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:37.967888 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25a531-1e20-4a9a-aa73-9072f45220c7 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:37.984452 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4fc239-89cd-424a-b010-7bd0ef48c794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:37.987126 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fc239-89cd-424a-b010-7bd0ef48c794 None admin] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:37.988365 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fc239-89cd-424a-b010-7bd0ef48c794 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:37.989022 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fc239-89cd-424a-b010-7bd0ef48c794 None admin] PATH_INFO: `/v3/users` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:37.990653 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4fc239-89cd-424a-b010-7bd0ef48c794 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:37.995159 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4fc239-89cd-424a-b010-7bd0ef48c794 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:38.042450 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 238/474] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 27 09:39:37 2022] POST /identity/v3/users => generated 248 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:39:38.114948 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25a531-1e20-4a9a-aa73-9072f45220c7 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:38.180635 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefeec2-b7b4-4ef4-ac94-67fa42c33fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:38.181656 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefeec2-b7b4-4ef4-ac94-67fa42c33fae None admin] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:38.182153 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefeec2-b7b4-4ef4-ac94-67fa42c33fae None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:38.182601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefeec2-b7b4-4ef4-ac94-67fa42c33fae None admin] PATH_INFO: `/v3/users` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:38.183872 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefeec2-b7b4-4ef4-ac94-67fa42c33fae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:38.186814 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefeec2-b7b4-4ef4-ac94-67fa42c33fae None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:38.227084 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 237/475] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 27 09:39:37 2022] POST /identity/v3/users => generated 249 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:39:41.493685 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7383c34-dd27-4b23-8dcc-eecbf328dcc4 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:41.494449 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7383c34-dd27-4b23-8dcc-eecbf328dcc4 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:41.494891 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7383c34-dd27-4b23-8dcc-eecbf328dcc4 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:41.497388 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 239/476] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:39:41.506565 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def69b4-85f1-4d44-a5ee-cdfef02f920c None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:41.507383 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def69b4-85f1-4d44-a5ee-cdfef02f920c None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:41.507689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def69b4-85f1-4d44-a5ee-cdfef02f920c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:41.535724 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adecc9-87f8-4c3d-9e7c-9dcd45a8bbc0 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:41.535990 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adecc9-87f8-4c3d-9e7c-9dcd45a8bbc0 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:41.538817 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adecc9-87f8-4c3d-9e7c-9dcd45a8bbc0 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:41.538817 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 240/477] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:39:41.544544 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d1a52-dd2f-4b41-ac5b-bea5d888931c None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:41.545000 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d1a52-dd2f-4b41-ac5b-bea5d888931c None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:41.545358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d1a52-dd2f-4b41-ac5b-bea5d888931c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:41.548234 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-8def69b4-85f1-4d44-a5ee-cdfef02f920c None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:41.550357 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-8def69b4-85f1-4d44-a5ee-cdfef02f920c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:41.565242 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-540d1a52-dd2f-4b41-ac5b-bea5d888931c None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:41.566748 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-540d1a52-dd2f-4b41-ac5b-bea5d888931c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:41.597023 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:41.664918 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 238/478] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 09:39:41.666637 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fc36b-6274-4d1b-9d2f-ba375ce4c1be None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:41.666983 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fc36b-6274-4d1b-9d2f-ba375ce4c1be None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:41.667260 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fc36b-6274-4d1b-9d2f-ba375ce4c1be None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:41.668646 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 239/479] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:41.674468 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a208b-1d8e-4874-a17f-0b971e8be5cf None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:41.674742 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a208b-1d8e-4874-a17f-0b971e8be5cf None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:41.675099 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a208b-1d8e-4874-a17f-0b971e8be5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:41.683366 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 241/480] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 09:39:41.696161 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-da3a208b-1d8e-4874-a17f-0b971e8be5cf None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:41.697738 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-da3a208b-1d8e-4874-a17f-0b971e8be5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:41.785185 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 240/481] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:39:42.029203 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d1a52-dd2f-4b41-ac5b-bea5d888931c None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:42.042945 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade073d0-86fe-44e9-b5c0-b294321e4a6a None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:42.043590 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade073d0-86fe-44e9-b5c0-b294321e4a6a None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:42.044084 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade073d0-86fe-44e9-b5c0-b294321e4a6a None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:42.046446 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 241/482] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:42.052714 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7f932-b201-4194-8137-82bf9d0e086a None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:42.053380 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7f932-b201-4194-8137-82bf9d0e086a None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:42.053897 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7f932-b201-4194-8137-82bf9d0e086a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:42.074631 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-fce7f932-b201-4194-8137-82bf9d0e086a None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:42.076322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-fce7f932-b201-4194-8137-82bf9d0e086a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:42.166834 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 242/483] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 09:39:42.167379 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7f932-b201-4194-8137-82bf9d0e086a None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:42.189722 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:42.242807 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d1a52-dd2f-4b41-ac5b-bea5d888931c None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:42.246816 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:42.288312 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fda35-1dbb-4a9f-a625-cfca446cc215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:42.288980 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fda35-1dbb-4a9f-a625-cfca446cc215 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:42.289252 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fda35-1dbb-4a9f-a625-cfca446cc215 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:42.289516 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fda35-1dbb-4a9f-a625-cfca446cc215 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:42.302059 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2fda35-1dbb-4a9f-a625-cfca446cc215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:42.307459 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-1c2fda35-1dbb-4a9f-a625-cfca446cc215 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:39:42.307459 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:42.307459 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:42.307459 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:42.307459 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:42.307459 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:42.307459 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:42.307459 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:42.307459 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:42.307459 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:42.307459 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:42.307459 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:42.307459 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:42.307459 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:42.307459 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:42.307459 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:42.308707 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:42.308707 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:42.308707 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:42.308707 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:42.308707 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:42.308707 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:42.308707 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:42.308707 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:42.308707 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:42.308707 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:42.308707 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:42.308707 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:42.308707 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:42.308707 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:42.308707 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:42.308707 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:42.309676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:42.309676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:42.309676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:42.309676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:42.309676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:42.309676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:42.309676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:42.309676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:42.309676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:42.309676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:42.309676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:39:42.309676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:42.311739 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 242/484] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 27 09:39:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:42.312649 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fda35-1dbb-4a9f-a625-cfca446cc215 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:42.331316 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7f932-b201-4194-8137-82bf9d0e086a None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:42.392168 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaedcbd-4946-4998-a6c6-00f7f3ea77a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:42.393195 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaedcbd-4946-4998-a6c6-00f7f3ea77a0 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:42.393629 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaedcbd-4946-4998-a6c6-00f7f3ea77a0 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:42.394045 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaedcbd-4946-4998-a6c6-00f7f3ea77a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:42.413988 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaedcbd-4946-4998-a6c6-00f7f3ea77a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:42.422067 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-cdaedcbd-4946-4998-a6c6-00f7f3ea77a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:39:42.422067 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:42.422067 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:42.422067 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:42.422067 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:42.422067 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:42.422067 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:42.422067 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:42.422067 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:42.422067 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:42.422067 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:42.422067 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:42.422067 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:42.422067 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:42.422067 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:42.422067 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:42.424361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:42.424361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:42.424361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:42.424361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:42.424361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:42.424361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:42.424361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:42.424361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:42.424361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:42.424361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:42.424361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:42.424361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:42.424361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:42.424361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:42.424361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:42.424361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:42.425896 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:42.425896 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:42.425896 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:42.425896 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:42.425896 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:42.425896 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:42.425896 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:42.425896 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:42.425896 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:42.425896 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:42.425896 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:39:42.425896 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:42.425896 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 243/485] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 27 09:39:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:42.425896 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaedcbd-4946-4998-a6c6-00f7f3ea77a0 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:42.504699 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fda35-1dbb-4a9f-a625-cfca446cc215 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:42.553723 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:42.554376 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a6f6a-c9e7-47ce-a12d-a44beab06bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:42.555090 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a6f6a-c9e7-47ce-a12d-a44beab06bef None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:42.555364 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a6f6a-c9e7-47ce-a12d-a44beab06bef None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:42.555836 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a6f6a-c9e7-47ce-a12d-a44beab06bef None admin] PATH_INFO: `/v3/roles/service` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:42.573666 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a6f6a-c9e7-47ce-a12d-a44beab06bef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:42.579582 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-117a6f6a-c9e7-47ce-a12d-a44beab06bef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:39:42.579582 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:42.579582 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:42.579582 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:42.579582 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:42.579582 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:42.579582 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:42.579582 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:42.579582 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:42.579582 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:42.579582 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:42.579582 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:42.579582 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:42.579582 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:42.579582 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:42.579582 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:42.580633 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:42.580633 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:42.580633 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:42.580633 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:42.580633 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:42.580633 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:42.580633 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:42.580633 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:42.580633 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:42.580633 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:42.580633 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:42.580633 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:42.580633 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:42.580633 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:42.580633 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:42.580633 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:42.581464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:42.581464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:42.581464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:42.581464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:42.581464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:42.581464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:42.581464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:42.581464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:42.581464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:42.581464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:42.581464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:39:42.581464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:42.581464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 243/486] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 27 09:39:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:42.582826 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a6f6a-c9e7-47ce-a12d-a44beab06bef None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:42.592036 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaedcbd-4946-4998-a6c6-00f7f3ea77a0 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:42.619143 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:42.637448 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1807679-1876-45e2-a2af-9f3c14aec11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:42.638176 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1807679-1876-45e2-a2af-9f3c14aec11f None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:42.638543 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1807679-1876-45e2-a2af-9f3c14aec11f None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:42.639026 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1807679-1876-45e2-a2af-9f3c14aec11f None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:42.640205 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1807679-1876-45e2-a2af-9f3c14aec11f None admin] RBAC: Adding query filter params (name=service) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:42.640696 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1807679-1876-45e2-a2af-9f3c14aec11f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:42.643167 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1807679-1876-45e2-a2af-9f3c14aec11f None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:42.655896 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 244/487] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 27 09:39:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:42.656943 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1807679-1876-45e2-a2af-9f3c14aec11f None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:42.746630 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a6f6a-c9e7-47ce-a12d-a44beab06bef None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:42.794033 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1807679-1876-45e2-a2af-9f3c14aec11f None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:42.795194 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f46005-cdd7-433e-8df3-9cc6a1199626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:42.795794 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f46005-cdd7-433e-8df3-9cc6a1199626 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:42.796067 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f46005-cdd7-433e-8df3-9cc6a1199626 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:42.796335 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f46005-cdd7-433e-8df3-9cc6a1199626 None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:42.797014 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f46005-cdd7-433e-8df3-9cc6a1199626 None admin] RBAC: Adding query filter params (name=service) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:42.797411 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f46005-cdd7-433e-8df3-9cc6a1199626 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:42.798853 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f46005-cdd7-433e-8df3-9cc6a1199626 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:42.808208 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 244/488] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 27 09:39:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:42.808835 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f46005-cdd7-433e-8df3-9cc6a1199626 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:42.850749 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96c095-8569-43cd-b52a-ef974f501dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:42.851445 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96c095-8569-43cd-b52a-ef974f501dee None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:42.851726 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96c095-8569-43cd-b52a-ef974f501dee None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:42.851985 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96c095-8569-43cd-b52a-ef974f501dee None admin] PATH_INFO: `/v3/roles/service` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:42.860479 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:42.864982 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96c095-8569-43cd-b52a-ef974f501dee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:42.870183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-bd96c095-8569-43cd-b52a-ef974f501dee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:39:42.870183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:42.870183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:42.870183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:42.870183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:42.870183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:42.870183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:42.870183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:42.870183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:42.870183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:42.870183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:42.870183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:42.870183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:42.870183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:42.870183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:42.870183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:42.871969 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:42.871969 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:42.871969 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:42.871969 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:42.871969 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:42.871969 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:42.871969 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:42.871969 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:42.871969 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:42.871969 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:42.871969 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:42.871969 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:42.871969 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:42.871969 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:42.871969 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:42.871969 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:42.873510 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:42.873510 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:42.873510 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:42.873510 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:42.873510 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:42.873510 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:42.873510 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:42.873510 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:42.873510 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:42.873510 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:42.873510 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:39:42.873510 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:42.873510 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 245/489] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 27 09:39:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:42.873510 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96c095-8569-43cd-b52a-ef974f501dee None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:42.923332 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:42.943107 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f46005-cdd7-433e-8df3-9cc6a1199626 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:42.981167 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f1f66-0b82-4435-83a0-12144d8dbb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:42.981797 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f1f66-0b82-4435-83a0-12144d8dbb92 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:42.982072 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f1f66-0b82-4435-83a0-12144d8dbb92 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:42.982336 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f1f66-0b82-4435-83a0-12144d8dbb92 None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:42.983059 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f1f66-0b82-4435-83a0-12144d8dbb92 None admin] RBAC: Adding query filter params (name=service) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:42.983416 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f1f66-0b82-4435-83a0-12144d8dbb92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:42.984822 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f1f66-0b82-4435-83a0-12144d8dbb92 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:42.994143 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 245/490] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 27 09:39:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:42.994838 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f1f66-0b82-4435-83a0-12144d8dbb92 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:42.997052 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96c095-8569-43cd-b52a-ef974f501dee None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:43.051553 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff98ba-24c9-4c98-acd3-f8832425fe6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:43.052504 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff98ba-24c9-4c98-acd3-f8832425fe6d None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:43.052878 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff98ba-24c9-4c98-acd3-f8832425fe6d None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:43.053373 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff98ba-24c9-4c98-acd3-f8832425fe6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:43.066230 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff98ba-24c9-4c98-acd3-f8832425fe6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:43.068052 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff98ba-24c9-4c98-acd3-f8832425fe6d None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:43.088994 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-87ff98ba-24c9-4c98-acd3-f8832425fe6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:43.088994 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:43.088994 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:43.088994 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:43.088994 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:43.088994 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:43.088994 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:43.088994 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:43.088994 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:43.088994 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:43.088994 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:43.088994 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:43.088994 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:39:43.088994 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:39:43.088994 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:39:43.088994 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:39:43.091252 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:43.091252 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:43.091252 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:43.091252 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:43.091252 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:43.091252 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:43.091252 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:43.091252 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:43.091252 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:43.091252 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:43.091252 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:43.091252 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:43.091252 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:43.091252 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:43.091252 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:43.091252 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:43.091252 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:39:43.092942 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:39:43.092942 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:43.092942 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:43.092942 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 246/491] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:43.092942 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff98ba-24c9-4c98-acd3-f8832425fe6d None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:43.131183 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f1f66-0b82-4435-83a0-12144d8dbb92 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:43.163547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:43.176239 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2d5e6-4e9a-413c-a3cc-df6ce79118a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:43.176883 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2d5e6-4e9a-413c-a3cc-df6ce79118a0 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:43.177217 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2d5e6-4e9a-413c-a3cc-df6ce79118a0 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:43.177494 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2d5e6-4e9a-413c-a3cc-df6ce79118a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:43.191734 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2d5e6-4e9a-413c-a3cc-df6ce79118a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:43.194334 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2d5e6-4e9a-413c-a3cc-df6ce79118a0 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:43.208527 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:43.216263 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-68b2d5e6-4e9a-413c-a3cc-df6ce79118a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:43.216263 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:43.216263 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:43.216263 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:43.216263 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:43.216263 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:43.216263 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:43.216263 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:43.216263 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:43.216263 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:43.216263 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:43.216263 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:43.216263 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:39:43.216263 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:39:43.216263 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:39:43.216263 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:39:43.218182 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:43.218182 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:43.218182 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:43.218182 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:43.218182 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:43.218182 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:43.218182 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:43.218182 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:43.218182 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:43.218182 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:43.218182 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:43.218182 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:43.218182 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:43.218182 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:43.218182 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:43.218182 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:43.218182 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:39:43.220124 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:39:43.220124 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:43.220124 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:43.222242 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 246/492] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:43.223202 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2d5e6-4e9a-413c-a3cc-df6ce79118a0 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:43.229714 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff98ba-24c9-4c98-acd3-f8832425fe6d None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:43.288094 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a97cd8-bfa9-4f4a-a153-2e54e3f6bada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:43.289043 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a97cd8-bfa9-4f4a-a153-2e54e3f6bada None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:43.289471 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a97cd8-bfa9-4f4a-a153-2e54e3f6bada None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:43.289896 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a97cd8-bfa9-4f4a-a153-2e54e3f6bada None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:43.291079 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a97cd8-bfa9-4f4a-a153-2e54e3f6bada None admin] RBAC: Adding query filter params (name=service) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:43.291608 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a97cd8-bfa9-4f4a-a153-2e54e3f6bada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:43.294142 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a97cd8-bfa9-4f4a-a153-2e54e3f6bada None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:43.308693 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 247/493] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 27 09:39:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:43.310201 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a97cd8-bfa9-4f4a-a153-2e54e3f6bada None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:43.329508 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2d5e6-4e9a-413c-a3cc-df6ce79118a0 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:43.367110 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774cced9-a03a-4cbe-bff0-c09f11710d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:43.367837 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cced9-a03a-4cbe-bff0-c09f11710d93 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:43.368170 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cced9-a03a-4cbe-bff0-c09f11710d93 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:43.368496 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cced9-a03a-4cbe-bff0-c09f11710d93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:43.380606 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774cced9-a03a-4cbe-bff0-c09f11710d93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:43.382207 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774cced9-a03a-4cbe-bff0-c09f11710d93 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:43.398228 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-774cced9-a03a-4cbe-bff0-c09f11710d93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:43.398228 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:43.398228 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:43.398228 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:43.398228 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:43.398228 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:43.398228 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:43.398228 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:43.398228 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:43.398228 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:43.398228 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:43.398228 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:43.398228 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:39:43.398228 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:39:43.398228 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:39:43.398228 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:39:43.399326 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:43.399326 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:43.399326 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:43.399326 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:43.399326 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:43.399326 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:43.399326 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:43.399326 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:43.399326 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:43.399326 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:43.399326 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:43.399326 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:43.399326 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:43.399326 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:43.399326 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:43.399326 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:43.399326 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:39:43.401384 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:39:43.401384 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:43.401384 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:43.401384 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 247/494] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:43.401384 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774cced9-a03a-4cbe-bff0-c09f11710d93 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:43.442662 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a97cd8-bfa9-4f4a-a153-2e54e3f6bada None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:43.457440 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:43.460000 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:43.479894 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f5ee8-4f07-4319-a608-2be3659082f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:43.480518 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f5ee8-4f07-4319-a608-2be3659082f1 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:43.480793 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f5ee8-4f07-4319-a608-2be3659082f1 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:43.481061 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f5ee8-4f07-4319-a608-2be3659082f1 None admin] PATH_INFO: `/v3/domains` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:43.481730 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f5ee8-4f07-4319-a608-2be3659082f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:43.482030 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f5ee8-4f07-4319-a608-2be3659082f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:43.483519 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f5ee8-4f07-4319-a608-2be3659082f1 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:43.504279 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 248/495] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:43.504279 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f5ee8-4f07-4319-a608-2be3659082f1 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:43.518553 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774cced9-a03a-4cbe-bff0-c09f11710d93 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:43.555594 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3d165-f20f-425b-af66-20da5a180b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:43.556227 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3d165-f20f-425b-af66-20da5a180b0b None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:43.556512 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3d165-f20f-425b-af66-20da5a180b0b None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:43.556781 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3d165-f20f-425b-af66-20da5a180b0b None admin] PATH_INFO: `/v3/domains` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:43.557447 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3d165-f20f-425b-af66-20da5a180b0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:43.557762 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3d165-f20f-425b-af66-20da5a180b0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:43.559260 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3d165-f20f-425b-af66-20da5a180b0b None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:43.578253 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 248/496] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:43.578253 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3d165-f20f-425b-af66-20da5a180b0b None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:43.628353 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f5ee8-4f07-4319-a608-2be3659082f1 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:43.667952 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccad36b-b1c0-42da-8d21-fc608e76e2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:43.668633 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccad36b-b1c0-42da-8d21-fc608e76e2c1 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:43.668970 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccad36b-b1c0-42da-8d21-fc608e76e2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:43.669371 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccad36b-b1c0-42da-8d21-fc608e76e2c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:43.681373 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccad36b-b1c0-42da-8d21-fc608e76e2c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:43.683123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccad36b-b1c0-42da-8d21-fc608e76e2c1 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:43.700721 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3d165-f20f-425b-af66-20da5a180b0b None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:43.702404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-2ccad36b-b1c0-42da-8d21-fc608e76e2c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:43.702404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:43.702404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:43.702404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:43.702404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:43.702404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:43.702404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:43.702404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:43.702404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:43.702404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:43.702404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:43.702404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:43.702404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:39:43.702404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:39:43.702404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:39:43.702404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:39:43.704018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:43.704018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:43.704018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:43.704018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:43.704018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:43.704018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:43.704018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:43.704018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:43.704018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:43.704018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:43.704018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:43.704018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:43.704018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:43.704018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:43.704018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:43.704018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:43.704018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:39:43.706399 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:39:43.706399 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:43.706399 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:43.706399 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 249/497] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:43.706399 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccad36b-b1c0-42da-8d21-fc608e76e2c1 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:43.717854 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:43.741903 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb2aad-2df9-4d7f-878e-83cd88ac4fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:43.742543 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb2aad-2df9-4d7f-878e-83cd88ac4fce None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:43.742836 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb2aad-2df9-4d7f-878e-83cd88ac4fce None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:43.743102 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb2aad-2df9-4d7f-878e-83cd88ac4fce None admin] PATH_INFO: `/v3/domains` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:43.743753 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb2aad-2df9-4d7f-878e-83cd88ac4fce None admin] RBAC: Adding query filter params (name=Default) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:43.744050 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb2aad-2df9-4d7f-878e-83cd88ac4fce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:43.745476 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb2aad-2df9-4d7f-878e-83cd88ac4fce None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:43.756776 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:43.758507 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 249/498] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:43.759585 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb2aad-2df9-4d7f-878e-83cd88ac4fce None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:43.857187 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccad36b-b1c0-42da-8d21-fc608e76e2c1 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:43.879796 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb2aad-2df9-4d7f-878e-83cd88ac4fce None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:43.898983 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a23c5-8d8e-480b-a879-016bfc6a3474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:43.900055 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a23c5-8d8e-480b-a879-016bfc6a3474 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:43.900555 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a23c5-8d8e-480b-a879-016bfc6a3474 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:43.901045 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a23c5-8d8e-480b-a879-016bfc6a3474 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:43.915095 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a23c5-8d8e-480b-a879-016bfc6a3474 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:43.917869 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a23c5-8d8e-480b-a879-016bfc6a3474 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:43.919828 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54aa9b-6ad0-4fb1-87e9-358a322c3b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:43.920612 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54aa9b-6ad0-4fb1-87e9-358a322c3b95 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:43.920973 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54aa9b-6ad0-4fb1-87e9-358a322c3b95 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:43.921340 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54aa9b-6ad0-4fb1-87e9-358a322c3b95 None admin] PATH_INFO: `/v3/users/nova` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:43.930108 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54aa9b-6ad0-4fb1-87e9-358a322c3b95 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:43.931604 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54aa9b-6ad0-4fb1-87e9-358a322c3b95 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:43.942206 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-488a23c5-8d8e-480b-a879-016bfc6a3474 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 27 09:39:43.942206 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:43.942206 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:43.942206 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:43.942206 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:43.942206 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:43.942206 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:43.942206 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:43.942206 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:43.942206 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:43.942206 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:43.942206 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:43.942206 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 09:39:43.942206 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 09:39:43.942206 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 09:39:43.942206 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 09:39:43.944161 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:43.944161 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:43.944161 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 09:39:43.944161 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:39:43.944161 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 09:39:43.944161 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:39:43.944161 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:43.944161 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:43.944161 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:43.944161 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:43.944161 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:43.944161 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:43.944161 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:43.944161 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:43.944161 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:43.944161 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:43.944161 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:43.944161 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:43.946063 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:43.946063 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:43.946063 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 09:39:43.946063 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 09:39:43.946063 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 09:39:43.946063 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 09:39:43.946063 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 09:39:43.946063 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 09:39:43.946063 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 27 09:39:43.946063 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:43.946063 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 250/499] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 27 09:39:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:43.947340 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a23c5-8d8e-480b-a879-016bfc6a3474 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:43.948634 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-2b54aa9b-6ad0-4fb1-87e9-358a322c3b95 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 09:39:43.948634 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:43.948634 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:43.948634 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:43.948634 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:43.948634 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:43.948634 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:43.948634 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:43.948634 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:43.948634 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:43.948634 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:43.948634 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:43.948634 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 09:39:43.948634 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 09:39:43.948634 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 09:39:43.948634 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 09:39:43.950204 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:43.950204 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:43.950204 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 09:39:43.950204 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:39:43.950204 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 09:39:43.950204 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:39:43.950204 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:43.950204 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:43.950204 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:43.950204 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:43.950204 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:43.950204 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:43.950204 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:43.950204 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:43.950204 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:43.950204 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:43.950204 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:43.950204 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:43.951938 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:43.951938 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:43.951938 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 09:39:43.951938 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 09:39:43.951938 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 09:39:43.951938 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 09:39:43.951938 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 09:39:43.951938 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 09:39:43.951938 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 09:39:43.951938 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:43.951938 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 250/500] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Sep 27 09:39:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:43.954012 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54aa9b-6ad0-4fb1-87e9-358a322c3b95 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:43.987977 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:44.051042 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:44.071732 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a23c5-8d8e-480b-a879-016bfc6a3474 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:44.091173 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54aa9b-6ad0-4fb1-87e9-358a322c3b95 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:44.133101 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404fa3e-d304-4ea1-baa2-c97ec8611377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:44.133951 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404fa3e-d304-4ea1-baa2-c97ec8611377 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:44.134367 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404fa3e-d304-4ea1-baa2-c97ec8611377 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:44.134497 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cc136-9b57-4a9b-8541-c20db853f356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:44.134812 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404fa3e-d304-4ea1-baa2-c97ec8611377 None admin] PATH_INFO: `/v3/domains` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:44.135382 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cc136-9b57-4a9b-8541-c20db853f356 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:44.135812 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404fa3e-d304-4ea1-baa2-c97ec8611377 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:44.135938 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cc136-9b57-4a9b-8541-c20db853f356 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:44.136240 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cc136-9b57-4a9b-8541-c20db853f356 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:44.136374 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404fa3e-d304-4ea1-baa2-c97ec8611377 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:44.138599 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404fa3e-d304-4ea1-baa2-c97ec8611377 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:44.148764 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680cc136-9b57-4a9b-8541-c20db853f356 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:44.151369 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680cc136-9b57-4a9b-8541-c20db853f356 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:44.159308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 251/501] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:44.160929 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404fa3e-d304-4ea1-baa2-c97ec8611377 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:44.171226 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-680cc136-9b57-4a9b-8541-c20db853f356 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 09:39:44.171226 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:44.171226 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:44.171226 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:44.171226 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:44.171226 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:44.171226 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:44.171226 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:44.171226 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:44.171226 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:44.171226 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:44.171226 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:44.171226 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 09:39:44.171226 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 09:39:44.171226 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 09:39:44.171226 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 09:39:44.173007 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:44.173007 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:44.173007 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 09:39:44.173007 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:39:44.173007 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 09:39:44.173007 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:39:44.173007 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:44.173007 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:44.173007 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:44.173007 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:44.173007 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:44.173007 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:44.173007 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:44.173007 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:44.173007 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:44.173007 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:44.173007 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:44.173007 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:44.174665 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:44.174665 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:44.174665 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 09:39:44.174665 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 09:39:44.174665 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 09:39:44.174665 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 09:39:44.174665 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 09:39:44.174665 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 09:39:44.174665 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 09:39:44.174665 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:44.174665 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 251/502] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:39:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:44.174665 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cc136-9b57-4a9b-8541-c20db853f356 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:44.287292 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:44.291752 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404fa3e-d304-4ea1-baa2-c97ec8611377 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:44.301629 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cc136-9b57-4a9b-8541-c20db853f356 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:44.327947 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738b02c-43df-4761-9dbd-1d4e287b4cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:44.328561 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738b02c-43df-4761-9dbd-1d4e287b4cdb None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:44.328835 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738b02c-43df-4761-9dbd-1d4e287b4cdb None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:44.329103 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738b02c-43df-4761-9dbd-1d4e287b4cdb None admin] PATH_INFO: `/v3/users` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:44.329825 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738b02c-43df-4761-9dbd-1d4e287b4cdb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:44.330132 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738b02c-43df-4761-9dbd-1d4e287b4cdb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:44.331614 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738b02c-43df-4761-9dbd-1d4e287b4cdb None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:44.369516 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78126f4-c837-4ea0-aef3-97a1c79728b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:44.370523 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78126f4-c837-4ea0-aef3-97a1c79728b4 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:44.371075 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78126f4-c837-4ea0-aef3-97a1c79728b4 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:44.371505 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78126f4-c837-4ea0-aef3-97a1c79728b4 None admin] PATH_INFO: `/v3/users` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:44.372784 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78126f4-c837-4ea0-aef3-97a1c79728b4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:44.373310 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78126f4-c837-4ea0-aef3-97a1c79728b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:44.375274 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 252/503] 10.222.0.49 () {56 vars in 1139 bytes} [Tue Sep 27 09:39:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:44.376086 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78126f4-c837-4ea0-aef3-97a1c79728b4 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:44.376281 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738b02c-43df-4761-9dbd-1d4e287b4cdb None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:44.382003 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:44.448347 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 252/504] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Sep 27 09:39:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:44.449672 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78126f4-c837-4ea0-aef3-97a1c79728b4 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:44.502739 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738b02c-43df-4761-9dbd-1d4e287b4cdb None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:44.542580 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370b74d-bb42-4490-abd6-c6b15b200509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:44.543417 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370b74d-bb42-4490-abd6-c6b15b200509 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:44.543793 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370b74d-bb42-4490-abd6-c6b15b200509 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:44.544139 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370b74d-bb42-4490-abd6-c6b15b200509 None admin] PATH_INFO: `/v3/users/glance` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:44.553089 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370b74d-bb42-4490-abd6-c6b15b200509 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:44.554658 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370b74d-bb42-4490-abd6-c6b15b200509 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:44.567679 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-3370b74d-bb42-4490-abd6-c6b15b200509 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 27 09:39:44.567679 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:44.567679 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:44.567679 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:44.567679 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:44.567679 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:44.567679 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:44.567679 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:44.567679 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:44.567679 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:44.567679 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:44.567679 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:44.567679 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 09:39:44.567679 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 09:39:44.567679 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 09:39:44.567679 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 09:39:44.569415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:44.569415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:44.569415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 09:39:44.569415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:39:44.569415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 09:39:44.569415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:39:44.569415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:44.569415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:44.569415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:44.569415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:44.569415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:44.569415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:44.569415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:44.569415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:44.569415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:44.569415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:44.569415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:44.569415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:44.571153 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:44.571153 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:44.571153 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 09:39:44.571153 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 09:39:44.571153 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 09:39:44.571153 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 09:39:44.571153 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 09:39:44.571153 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 09:39:44.571153 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 27 09:39:44.571153 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:44.571153 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 253/505] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:39:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:44.571153 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370b74d-bb42-4490-abd6-c6b15b200509 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:44.586463 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78126f4-c837-4ea0-aef3-97a1c79728b4 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:44.632658 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277d074-110e-43c2-ad64-5f5d1c2c24f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:44.633479 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277d074-110e-43c2-ad64-5f5d1c2c24f2 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:44.633834 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277d074-110e-43c2-ad64-5f5d1c2c24f2 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:44.634286 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277d074-110e-43c2-ad64-5f5d1c2c24f2 None admin] PATH_INFO: `/v3/users` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:44.635188 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277d074-110e-43c2-ad64-5f5d1c2c24f2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:44.635554 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277d074-110e-43c2-ad64-5f5d1c2c24f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:44.637113 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277d074-110e-43c2-ad64-5f5d1c2c24f2 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:44.647703 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:44.659468 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 253/506] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Sep 27 09:39:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:44.660550 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277d074-110e-43c2-ad64-5f5d1c2c24f2 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:44.674006 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:44.700586 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370b74d-bb42-4490-abd6-c6b15b200509 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:44.741351 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c71a83-7d96-4726-a65e-064bd3191fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:44.741968 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c71a83-7d96-4726-a65e-064bd3191fc0 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:44.742241 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c71a83-7d96-4726-a65e-064bd3191fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:44.742508 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c71a83-7d96-4726-a65e-064bd3191fc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:44.789335 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277d074-110e-43c2-ad64-5f5d1c2c24f2 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:44.821807 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c71a83-7d96-4726-a65e-064bd3191fc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:44.823350 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c71a83-7d96-4726-a65e-064bd3191fc0 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:44.837015 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42495ba-0700-4d2e-aad7-386f46484be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:44.837630 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42495ba-0700-4d2e-aad7-386f46484be4 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:44.837904 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42495ba-0700-4d2e-aad7-386f46484be4 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:44.838171 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42495ba-0700-4d2e-aad7-386f46484be4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:44.901632 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:44.928697 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42495ba-0700-4d2e-aad7-386f46484be4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:44.930354 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42495ba-0700-4d2e-aad7-386f46484be4 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:44.941378 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:44.957038 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 254/507] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:39:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:39:44.958014 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c71a83-7d96-4726-a65e-064bd3191fc0 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:45.061397 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 254/508] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:39:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:39:45.062623 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42495ba-0700-4d2e-aad7-386f46484be4 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:45.104793 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c71a83-7d96-4726-a65e-064bd3191fc0 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:45.149846 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65de24d-cc52-41da-aecd-e1a12a464bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:45.150633 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65de24d-cc52-41da-aecd-e1a12a464bbb None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:45.151031 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65de24d-cc52-41da-aecd-e1a12a464bbb None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:45.151413 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65de24d-cc52-41da-aecd-e1a12a464bbb None admin] PATH_INFO: `/v3/users` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:45.152197 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65de24d-cc52-41da-aecd-e1a12a464bbb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:45.152538 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65de24d-cc52-41da-aecd-e1a12a464bbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:45.154172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65de24d-cc52-41da-aecd-e1a12a464bbb None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:45.175124 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 255/509] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Sep 27 09:39:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:45.176214 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65de24d-cc52-41da-aecd-e1a12a464bbb None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:45.188921 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42495ba-0700-4d2e-aad7-386f46484be4 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:45.201137 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:45.203744 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:45.229926 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6025a-f9ae-4d52-8259-a903fc33ee39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:45.230450 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6025a-f9ae-4d52-8259-a903fc33ee39 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:45.230722 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6025a-f9ae-4d52-8259-a903fc33ee39 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:45.231020 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6025a-f9ae-4d52-8259-a903fc33ee39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:45.300167 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65de24d-cc52-41da-aecd-e1a12a464bbb None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:45.303659 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6025a-f9ae-4d52-8259-a903fc33ee39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:45.305300 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6025a-f9ae-4d52-8259-a903fc33ee39 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:45.338599 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5050f0f-f4b5-495f-9a86-bb80747d7a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:45.339433 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5050f0f-f4b5-495f-9a86-bb80747d7a4e None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:45.339809 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5050f0f-f4b5-495f-9a86-bb80747d7a4e None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:45.340179 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5050f0f-f4b5-495f-9a86-bb80747d7a4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:45.351902 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5050f0f-f4b5-495f-9a86-bb80747d7a4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:45.353353 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5050f0f-f4b5-495f-9a86-bb80747d7a4e None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:45.369842 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-d5050f0f-f4b5-495f-9a86-bb80747d7a4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:45.369842 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:45.369842 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:45.369842 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:45.369842 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:45.369842 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:45.369842 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:45.369842 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:45.369842 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:45.369842 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:45.369842 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:45.369842 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:45.369842 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:39:45.369842 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:39:45.369842 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:39:45.369842 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:39:45.371490 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:45.371490 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:45.371490 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:45.371490 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:45.371490 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:45.371490 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:45.371490 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:45.371490 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:45.371490 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:45.371490 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:45.371490 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:45.371490 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:45.371490 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:45.371490 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:45.371490 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:45.371490 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:45.371490 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:39:45.373065 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:39:45.373065 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:45.373065 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:45.373065 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 256/510] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:45.373065 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5050f0f-f4b5-495f-9a86-bb80747d7a4e None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:45.425976 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 255/511] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:39:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:39:45.427521 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6025a-f9ae-4d52-8259-a903fc33ee39 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:45.438657 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:45.465868 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:45.492823 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5050f0f-f4b5-495f-9a86-bb80747d7a4e None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:45.531531 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812a172-d158-402f-b35e-c0ac299269c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:45.532305 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812a172-d158-402f-b35e-c0ac299269c8 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:45.532741 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812a172-d158-402f-b35e-c0ac299269c8 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:45.533079 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812a172-d158-402f-b35e-c0ac299269c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:45.539649 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6025a-f9ae-4d52-8259-a903fc33ee39 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:45.544987 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812a172-d158-402f-b35e-c0ac299269c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:45.546477 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812a172-d158-402f-b35e-c0ac299269c8 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:45.562219 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-7812a172-d158-402f-b35e-c0ac299269c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:45.562219 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:45.562219 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:45.562219 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:45.562219 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:45.562219 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:45.562219 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:45.562219 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:45.562219 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:45.562219 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:45.562219 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:45.562219 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:45.562219 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:39:45.562219 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:39:45.562219 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:39:45.562219 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:39:45.564044 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:45.564044 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:45.564044 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:45.564044 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:45.564044 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:45.564044 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:45.564044 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:45.564044 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:45.564044 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:45.564044 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:45.564044 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:45.564044 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:45.564044 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:45.564044 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:45.564044 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:45.564044 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:45.564044 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:39:45.565674 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:39:45.565674 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:45.565674 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:45.565674 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 257/512] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:45.565674 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812a172-d158-402f-b35e-c0ac299269c8 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:45.594109 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db91348-0bb1-4e03-9142-ceccaf0092e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:45.594725 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db91348-0bb1-4e03-9142-ceccaf0092e6 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:45.595064 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db91348-0bb1-4e03-9142-ceccaf0092e6 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:45.595335 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db91348-0bb1-4e03-9142-ceccaf0092e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:45.677578 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db91348-0bb1-4e03-9142-ceccaf0092e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:45.679239 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db91348-0bb1-4e03-9142-ceccaf0092e6 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:45.681794 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812a172-d158-402f-b35e-c0ac299269c8 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:45.690214 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:45.709118 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:45.719369 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d2f25-02c5-40a9-9e05-c9f527b6d60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:45.719978 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d2f25-02c5-40a9-9e05-c9f527b6d60d None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:45.720259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d2f25-02c5-40a9-9e05-c9f527b6d60d None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:45.720503 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d2f25-02c5-40a9-9e05-c9f527b6d60d None admin] PATH_INFO: `/v3/domains` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:45.721168 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d2f25-02c5-40a9-9e05-c9f527b6d60d None admin] RBAC: Adding query filter params (name=Default) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:45.721469 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d2f25-02c5-40a9-9e05-c9f527b6d60d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:45.722868 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d2f25-02c5-40a9-9e05-c9f527b6d60d None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:45.736553 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 258/513] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:45.737544 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d2f25-02c5-40a9-9e05-c9f527b6d60d None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:45.794299 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 256/514] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:39:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:39:45.794596 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db91348-0bb1-4e03-9142-ceccaf0092e6 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:45.866415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d2f25-02c5-40a9-9e05-c9f527b6d60d None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:45.916899 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fb814-6e76-44a6-9943-6f71bcb4abe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:45.917939 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fb814-6e76-44a6-9943-6f71bcb4abe4 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:45.918407 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fb814-6e76-44a6-9943-6f71bcb4abe4 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:45.918909 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fb814-6e76-44a6-9943-6f71bcb4abe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:45.926172 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db91348-0bb1-4e03-9142-ceccaf0092e6 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:45.936581 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:45.937088 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fb814-6e76-44a6-9943-6f71bcb4abe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:45.940525 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fb814-6e76-44a6-9943-6f71bcb4abe4 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:45.962246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-3f7fb814-6e76-44a6-9943-6f71bcb4abe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:45.962246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:45.962246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:45.962246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:45.962246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:45.962246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:45.962246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:45.962246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:45.962246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:45.962246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:45.962246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:45.962246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:45.962246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:39:45.962246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:39:45.962246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:39:45.962246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:39:45.963415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:45.963415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:45.963415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:45.963415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:45.963415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:45.963415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:45.963415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:45.963415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:45.963415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:45.963415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:45.963415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:45.963415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:45.963415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:45.963415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:45.963415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:45.963415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:45.963415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:39:45.964240 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:39:45.964240 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:45.964240 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:45.964240 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 259/515] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:45.964240 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fb814-6e76-44a6-9943-6f71bcb4abe4 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:45.967392 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9e1b0-f5b9-46dd-8c17-f9bf6cc9cfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:45.968333 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9e1b0-f5b9-46dd-8c17-f9bf6cc9cfc8 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:45.968486 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9e1b0-f5b9-46dd-8c17-f9bf6cc9cfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:45.968778 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9e1b0-f5b9-46dd-8c17-f9bf6cc9cfc8 None admin] PATH_INFO: `/v3/domains` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:45.969448 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9e1b0-f5b9-46dd-8c17-f9bf6cc9cfc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:45.969757 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9e1b0-f5b9-46dd-8c17-f9bf6cc9cfc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:45.971197 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9e1b0-f5b9-46dd-8c17-f9bf6cc9cfc8 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:45.984278 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 257/516] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:45.985697 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9e1b0-f5b9-46dd-8c17-f9bf6cc9cfc8 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:46.009278 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:46.076819 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fb814-6e76-44a6-9943-6f71bcb4abe4 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:46.103155 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9e1b0-f5b9-46dd-8c17-f9bf6cc9cfc8 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:46.123234 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c513c8d-77a6-427f-9c0c-29b23a801bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:46.123929 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c513c8d-77a6-427f-9c0c-29b23a801bcc None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:46.124243 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c513c8d-77a6-427f-9c0c-29b23a801bcc None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:46.124552 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c513c8d-77a6-427f-9c0c-29b23a801bcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:46.133889 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c513c8d-77a6-427f-9c0c-29b23a801bcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:46.135647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c513c8d-77a6-427f-9c0c-29b23a801bcc None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:46.143452 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459187f-d1c0-4967-9689-25d7e7b300c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:46.144394 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459187f-d1c0-4967-9689-25d7e7b300c0 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:46.144811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459187f-d1c0-4967-9689-25d7e7b300c0 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:46.145239 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459187f-d1c0-4967-9689-25d7e7b300c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:46.150566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-4c513c8d-77a6-427f-9c0c-29b23a801bcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:39:46.150566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:46.150566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:46.150566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:46.150566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:46.150566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:46.150566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:46.150566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:46.150566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:46.150566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:46.150566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:46.150566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:46.150566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 09:39:46.150566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 09:39:46.150566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 09:39:46.152434 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 09:39:46.152434 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:46.152434 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:46.152434 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:46.152434 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:46.152434 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:46.152434 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:46.152434 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:46.152434 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:46.152434 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:46.152434 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:46.152434 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:46.152434 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:46.152434 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:46.152434 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:46.152434 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:46.152434 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:46.154057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 09:39:46.154057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 09:39:46.154057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 09:39:46.154057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 09:39:46.154057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 09:39:46.154057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 09:39:46.154057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:39:46.154057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:46.154057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 260/517] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:39:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:46.154057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c513c8d-77a6-427f-9c0c-29b23a801bcc None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:46.164272 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459187f-d1c0-4967-9689-25d7e7b300c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:46.166562 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459187f-d1c0-4967-9689-25d7e7b300c0 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:46.186484 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-7459187f-d1c0-4967-9689-25d7e7b300c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:46.186484 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:46.186484 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:46.186484 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:46.186484 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:46.186484 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:46.186484 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:46.186484 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:46.186484 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:46.186484 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:46.186484 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:46.186484 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:46.186484 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:39:46.186484 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:39:46.186484 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:39:46.186484 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:39:46.188607 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:46.188607 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:46.188607 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:46.188607 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:46.188607 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:46.188607 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:46.188607 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:46.188607 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:46.188607 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:46.188607 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:46.188607 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:46.188607 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:46.188607 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:46.188607 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:46.188607 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:46.188607 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:46.188607 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:39:46.190353 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:39:46.190353 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:46.190353 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:46.190353 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 258/518] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:46.190353 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459187f-d1c0-4967-9689-25d7e7b300c0 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:46.221130 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:46.276316 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:46.281848 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c513c8d-77a6-427f-9c0c-29b23a801bcc None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:46.322409 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cac60d-1a85-4dd8-b522-785d45760873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:46.323215 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cac60d-1a85-4dd8-b522-785d45760873 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:46.323430 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459187f-d1c0-4967-9689-25d7e7b300c0 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:46.323667 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cac60d-1a85-4dd8-b522-785d45760873 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:46.324026 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cac60d-1a85-4dd8-b522-785d45760873 None admin] PATH_INFO: `/v3/domains` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:46.324773 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cac60d-1a85-4dd8-b522-785d45760873 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:46.325183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cac60d-1a85-4dd8-b522-785d45760873 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:46.327208 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cac60d-1a85-4dd8-b522-785d45760873 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:46.342071 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 261/519] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:46.343100 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cac60d-1a85-4dd8-b522-785d45760873 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:46.372454 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1895733-677b-4619-9261-4add4337e537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:46.373192 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1895733-677b-4619-9261-4add4337e537 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:46.373607 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1895733-677b-4619-9261-4add4337e537 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:46.374052 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1895733-677b-4619-9261-4add4337e537 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:46.383469 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1895733-677b-4619-9261-4add4337e537 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:46.385269 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1895733-677b-4619-9261-4add4337e537 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:46.399651 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-d1895733-677b-4619-9261-4add4337e537 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:39:46.399651 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:46.399651 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:46.399651 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:46.399651 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:46.399651 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:46.399651 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:46.399651 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:46.399651 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:46.399651 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:46.399651 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:46.399651 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:46.399651 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 09:39:46.399651 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 09:39:46.399651 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 09:39:46.401530 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 09:39:46.401530 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:46.401530 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:46.401530 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:46.401530 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:46.401530 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:46.401530 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:46.401530 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:46.401530 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:46.401530 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:46.401530 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:46.401530 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:46.401530 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:46.401530 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:46.401530 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:46.401530 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:46.401530 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:46.411171 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 09:39:46.411171 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 09:39:46.411171 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 09:39:46.411171 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 09:39:46.411171 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 09:39:46.411171 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 09:39:46.411171 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:39:46.411171 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:46.411171 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 259/520] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:39:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:46.411171 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1895733-677b-4619-9261-4add4337e537 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:46.471306 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cac60d-1a85-4dd8-b522-785d45760873 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:46.539387 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d65486-29bd-44f9-8729-875207db9fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:46.540030 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d65486-29bd-44f9-8729-875207db9fc5 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:46.540312 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d65486-29bd-44f9-8729-875207db9fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:46.540577 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d65486-29bd-44f9-8729-875207db9fc5 None admin] PATH_INFO: `/v3/projects` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:46.541298 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d65486-29bd-44f9-8729-875207db9fc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:46.541596 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d65486-29bd-44f9-8729-875207db9fc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:46.543151 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d65486-29bd-44f9-8729-875207db9fc5 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:46.554557 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:46.566047 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 262/521] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 27 09:39:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:46.566982 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d65486-29bd-44f9-8729-875207db9fc5 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:46.601907 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:46.605548 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1895733-677b-4619-9261-4add4337e537 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:46.656806 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd897a8-5841-41fe-a2d0-b94b6ae0bce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:46.657433 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd897a8-5841-41fe-a2d0-b94b6ae0bce8 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:46.657737 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd897a8-5841-41fe-a2d0-b94b6ae0bce8 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:46.657983 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd897a8-5841-41fe-a2d0-b94b6ae0bce8 None admin] PATH_INFO: `/v3/domains` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:46.658645 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd897a8-5841-41fe-a2d0-b94b6ae0bce8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:46.658985 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd897a8-5841-41fe-a2d0-b94b6ae0bce8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:46.660457 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd897a8-5841-41fe-a2d0-b94b6ae0bce8 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:46.674341 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 260/522] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:46.675243 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd897a8-5841-41fe-a2d0-b94b6ae0bce8 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:46.718275 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d65486-29bd-44f9-8729-875207db9fc5 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:46.765314 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6048131-6db2-49bc-a6da-7a6eff4684ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:46.766381 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6048131-6db2-49bc-a6da-7a6eff4684ad None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:46.766895 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6048131-6db2-49bc-a6da-7a6eff4684ad None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:46.767356 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6048131-6db2-49bc-a6da-7a6eff4684ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:46.779665 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6048131-6db2-49bc-a6da-7a6eff4684ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:46.782433 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6048131-6db2-49bc-a6da-7a6eff4684ad None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:46.804622 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-d6048131-6db2-49bc-a6da-7a6eff4684ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:39:46.804622 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:46.804622 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:46.804622 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:46.804622 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:46.804622 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:46.804622 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:46.804622 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:46.804622 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:46.804622 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:46.804622 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:46.804622 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:46.804622 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 09:39:46.804622 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 09:39:46.804622 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 09:39:46.806034 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 09:39:46.806034 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:46.806034 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:46.806034 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:46.806034 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:46.806034 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:46.806034 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:46.806034 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:46.806034 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:46.806034 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:46.806034 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:46.806034 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:46.806034 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:46.806034 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:46.806034 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:46.806034 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:46.806034 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:46.807337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 09:39:46.807337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 09:39:46.807337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 09:39:46.807337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 09:39:46.807337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 09:39:46.807337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 09:39:46.807337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:39:46.807337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:46.807337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 263/523] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:39:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:46.808187 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6048131-6db2-49bc-a6da-7a6eff4684ad None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:46.811344 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd897a8-5841-41fe-a2d0-b94b6ae0bce8 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:46.849701 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073ce4a-c0b9-4aa9-9a56-ee9c75070ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:46.850309 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073ce4a-c0b9-4aa9-9a56-ee9c75070ceb None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:46.850593 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073ce4a-c0b9-4aa9-9a56-ee9c75070ceb None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:46.850918 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073ce4a-c0b9-4aa9-9a56-ee9c75070ceb None admin] PATH_INFO: `/v3/projects` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:46.852235 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073ce4a-c0b9-4aa9-9a56-ee9c75070ceb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:46.852570 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073ce4a-c0b9-4aa9-9a56-ee9c75070ceb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:46.854060 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073ce4a-c0b9-4aa9-9a56-ee9c75070ceb None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:46.869703 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:46.874506 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 261/524] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 27 09:39:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:46.875450 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073ce4a-c0b9-4aa9-9a56-ee9c75070ceb None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:46.936936 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:46.974987 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6048131-6db2-49bc-a6da-7a6eff4684ad None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:46.989544 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073ce4a-c0b9-4aa9-9a56-ee9c75070ceb None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:47.014543 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9034d5-730e-4939-8e29-1f7cfdf445e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:47.015337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9034d5-730e-4939-8e29-1f7cfdf445e0 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:47.015613 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9034d5-730e-4939-8e29-1f7cfdf445e0 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:47.016022 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9034d5-730e-4939-8e29-1f7cfdf445e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:47.016763 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9034d5-730e-4939-8e29-1f7cfdf445e0 None admin] RBAC: Adding query filter params (role.id=a3ad332ff078405ebc48aa8df0035cab, scope.project.id=dbe5c492b05e40448942bb2500c185ee, user.id=5a8283aa6cda48fa9a6b2f42fc498238) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:47.017139 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9034d5-730e-4939-8e29-1f7cfdf445e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:47.018993 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9034d5-730e-4939-8e29-1f7cfdf445e0 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:47.026710 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 264/525] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:39:46 2022] GET /identity/v3/role_assignments?user.id=5a8283aa6cda48fa9a6b2f42fc498238&scope.project.id=dbe5c492b05e40448942bb2500c185ee&role.id=a3ad332ff078405ebc48aa8df0035cab => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:47.027990 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9034d5-730e-4939-8e29-1f7cfdf445e0 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:47.032193 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910092e-cc3b-4981-bedd-0c347b21699b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:47.033232 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910092e-cc3b-4981-bedd-0c347b21699b None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:47.033562 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910092e-cc3b-4981-bedd-0c347b21699b None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:47.033873 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910092e-cc3b-4981-bedd-0c347b21699b None admin] PATH_INFO: `/v3/projects/service` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:47.044331 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910092e-cc3b-4981-bedd-0c347b21699b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:47.046005 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910092e-cc3b-4981-bedd-0c347b21699b None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:47.059288 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-e910092e-cc3b-4981-bedd-0c347b21699b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:39:47.059288 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:47.059288 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:47.059288 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:47.059288 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:47.059288 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:47.059288 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:47.059288 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:47.059288 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:47.059288 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:47.059288 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:47.059288 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:47.059288 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 09:39:47.059288 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 09:39:47.059288 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 09:39:47.060725 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 09:39:47.060725 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:47.060725 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:47.060725 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:47.060725 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:47.060725 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:47.060725 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:47.060725 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:47.060725 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:47.060725 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:47.060725 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:47.060725 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:47.060725 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:47.060725 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:47.060725 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:47.060725 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:47.060725 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:47.062405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 09:39:47.062405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 09:39:47.062405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 09:39:47.062405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 09:39:47.062405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 09:39:47.062405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 09:39:47.062405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:39:47.062405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:47.065519 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 262/526] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:39:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:47.066579 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910092e-cc3b-4981-bedd-0c347b21699b None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:47.155864 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:47.201429 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9034d5-730e-4939-8e29-1f7cfdf445e0 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:47.224551 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910092e-cc3b-4981-bedd-0c347b21699b None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:47.264991 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55feffd-a604-4fdb-92d3-9eb56faa9034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:47.265949 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55feffd-a604-4fdb-92d3-9eb56faa9034 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:47.266131 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaca0bb-6df1-4f86-a6c1-bcf5de78d140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:47.266338 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55feffd-a604-4fdb-92d3-9eb56faa9034 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:47.266427 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55feffd-a604-4fdb-92d3-9eb56faa9034 None admin] PATH_INFO: `/v3/projects` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:47.266935 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaca0bb-6df1-4f86-a6c1-bcf5de78d140 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:47.267255 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaca0bb-6df1-4f86-a6c1-bcf5de78d140 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:47.267407 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55feffd-a604-4fdb-92d3-9eb56faa9034 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:47.267654 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaca0bb-6df1-4f86-a6c1-bcf5de78d140 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:47.267786 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55feffd-a604-4fdb-92d3-9eb56faa9034 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:47.268606 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaca0bb-6df1-4f86-a6c1-bcf5de78d140 None admin] RBAC: Adding query filter params (role.id=a3ad332ff078405ebc48aa8df0035cab, scope.project.id=dbe5c492b05e40448942bb2500c185ee, user.id=bda026ed208d4736938da05121a06f4e) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:47.268884 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaca0bb-6df1-4f86-a6c1-bcf5de78d140 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:47.269432 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55feffd-a604-4fdb-92d3-9eb56faa9034 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:47.270410 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaca0bb-6df1-4f86-a6c1-bcf5de78d140 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:47.276731 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 263/527] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:39:47 2022] GET /identity/v3/role_assignments?user.id=bda026ed208d4736938da05121a06f4e&scope.project.id=dbe5c492b05e40448942bb2500c185ee&role.id=a3ad332ff078405ebc48aa8df0035cab => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:47.277377 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaca0bb-6df1-4f86-a6c1-bcf5de78d140 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:47.289757 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 265/528] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 27 09:39:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:47.299041 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55feffd-a604-4fdb-92d3-9eb56faa9034 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:47.306783 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:47.421905 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaca0bb-6df1-4f86-a6c1-bcf5de78d140 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:47.435082 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55feffd-a604-4fdb-92d3-9eb56faa9034 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:47.468455 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:47.485687 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2ba5d-2ce2-4aa9-ba49-1fbc1fa9f2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:47.486593 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2ba5d-2ce2-4aa9-ba49-1fbc1fa9f2cb None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:47.487082 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2ba5d-2ce2-4aa9-ba49-1fbc1fa9f2cb None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:47.487487 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2ba5d-2ce2-4aa9-ba49-1fbc1fa9f2cb None admin] PATH_INFO: `/v3/projects` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:47.488087 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42302aa0-6155-4859-b1af-f154c6fc12f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:47.488726 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c2ba5d-2ce2-4aa9-ba49-1fbc1fa9f2cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:47.488975 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42302aa0-6155-4859-b1af-f154c6fc12f4 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:47.489342 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42302aa0-6155-4859-b1af-f154c6fc12f4 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:47.489449 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c2ba5d-2ce2-4aa9-ba49-1fbc1fa9f2cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:47.489893 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42302aa0-6155-4859-b1af-f154c6fc12f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:47.490724 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42302aa0-6155-4859-b1af-f154c6fc12f4 None admin] RBAC: Adding query filter params (role.id=a3ad332ff078405ebc48aa8df0035cab, scope.project.id=dbe5c492b05e40448942bb2500c185ee, user.id=25ffb8d1c3014daab3b00e2a059af76b) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:47.491143 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42302aa0-6155-4859-b1af-f154c6fc12f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:47.491726 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c2ba5d-2ce2-4aa9-ba49-1fbc1fa9f2cb None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:47.492791 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42302aa0-6155-4859-b1af-f154c6fc12f4 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:47.507279 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 266/529] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:39:47 2022] GET /identity/v3/role_assignments?user.id=25ffb8d1c3014daab3b00e2a059af76b&scope.project.id=dbe5c492b05e40448942bb2500c185ee&role.id=a3ad332ff078405ebc48aa8df0035cab => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:47.509091 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 264/530] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 27 09:39:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:47.515539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42302aa0-6155-4859-b1af-f154c6fc12f4 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:47.623198 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:47.670342 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42302aa0-6155-4859-b1af-f154c6fc12f4 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:47.715900 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661f1ea-ee78-4fd1-880b-2439648efe54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:47.716931 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661f1ea-ee78-4fd1-880b-2439648efe54 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:47.717379 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661f1ea-ee78-4fd1-880b-2439648efe54 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:47.717793 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661f1ea-ee78-4fd1-880b-2439648efe54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:47.718723 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661f1ea-ee78-4fd1-880b-2439648efe54 None admin] RBAC: Adding query filter params (role.id=a3ad332ff078405ebc48aa8df0035cab, scope.project.id=dbe5c492b05e40448942bb2500c185ee, user.id=1575d436c7d043d886293e24fa5f64fb) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:47.719885 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661f1ea-ee78-4fd1-880b-2439648efe54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:47.722498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661f1ea-ee78-4fd1-880b-2439648efe54 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:47.734700 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 267/531] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:39:47 2022] GET /identity/v3/role_assignments?user.id=1575d436c7d043d886293e24fa5f64fb&scope.project.id=dbe5c492b05e40448942bb2500c185ee&role.id=a3ad332ff078405ebc48aa8df0035cab => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:49.910338 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269d293-132a-44b3-80db-a95e252f30fd None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:49.910925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269d293-132a-44b3-80db-a95e252f30fd None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:49.911225 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269d293-132a-44b3-80db-a95e252f30fd None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:49.914172 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 265/532] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:49.923170 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12da7df-0a67-428f-b3b2-bf5d080f83d5 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:49.923689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12da7df-0a67-428f-b3b2-bf5d080f83d5 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:49.924096 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12da7df-0a67-428f-b3b2-bf5d080f83d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:49.932488 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f55fd1-21bc-4408-b8af-1ab04b728883 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:49.932779 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f55fd1-21bc-4408-b8af-1ab04b728883 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:49.933045 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f55fd1-21bc-4408-b8af-1ab04b728883 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:49.934716 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 266/533] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:39:49.940391 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aab433-2e69-462f-8c49-9c47b673e806 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:49.940671 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aab433-2e69-462f-8c49-9c47b673e806 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:49.940945 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aab433-2e69-462f-8c49-9c47b673e806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:49.956569 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-e12da7df-0a67-428f-b3b2-bf5d080f83d5 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:49.958626 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-e12da7df-0a67-428f-b3b2-bf5d080f83d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:49.960201 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-51aab433-2e69-462f-8c49-9c47b673e806 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:49.961418 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-51aab433-2e69-462f-8c49-9c47b673e806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:50.069916 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 267/534] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 09:39:50.098600 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 268/535] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:39:50.138474 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc0623-02eb-42c0-9dfc-36acd0fbf707 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:50.139177 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc0623-02eb-42c0-9dfc-36acd0fbf707 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:50.139649 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc0623-02eb-42c0-9dfc-36acd0fbf707 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:50.141609 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 268/536] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:50.147771 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa6d2b-1521-4243-bf08-145d9b960511 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:50.148078 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa6d2b-1521-4243-bf08-145d9b960511 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:50.148316 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa6d2b-1521-4243-bf08-145d9b960511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:50.168970 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-29aa6d2b-1521-4243-bf08-145d9b960511 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:50.170082 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-29aa6d2b-1521-4243-bf08-145d9b960511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:50.241935 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:50.254822 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 269/537] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:39:50.458294 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc0623-02eb-42c0-9dfc-36acd0fbf707 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:50.490357 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c659f-c603-4e85-a75a-ad32c436209f None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:50.490740 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c659f-c603-4e85-a75a-ad32c436209f None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:50.491054 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c659f-c603-4e85-a75a-ad32c436209f None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:50.492738 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 270/538] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:39:50.498396 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe96fe9-bdb9-4ee5-8bec-9eddea7b1ac8 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:50.498671 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe96fe9-bdb9-4ee5-8bec-9eddea7b1ac8 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:50.498988 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe96fe9-bdb9-4ee5-8bec-9eddea7b1ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:50.519568 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-efe96fe9-bdb9-4ee5-8bec-9eddea7b1ac8 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:50.521361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-efe96fe9-bdb9-4ee5-8bec-9eddea7b1ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:50.614733 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc0623-02eb-42c0-9dfc-36acd0fbf707 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:50.616277 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 271/539] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:39:50.617316 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe96fe9-bdb9-4ee5-8bec-9eddea7b1ac8 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:50.634042 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:50.662373 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d6c09-7edf-4de3-b9ea-6d6bca92ab93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:50.663465 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d6c09-7edf-4de3-b9ea-6d6bca92ab93 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:50.664066 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d6c09-7edf-4de3-b9ea-6d6bca92ab93 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:50.664515 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d6c09-7edf-4de3-b9ea-6d6bca92ab93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:50.678475 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d6c09-7edf-4de3-b9ea-6d6bca92ab93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:50.684081 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-679d6c09-7edf-4de3-b9ea-6d6bca92ab93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:39:50.684081 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:50.684081 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:50.684081 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:50.684081 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:50.684081 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:50.684081 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:50.684081 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:50.684081 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:50.684081 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:50.684081 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:50.684081 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:50.684081 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:50.684081 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:50.684081 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:50.684081 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:50.685019 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:50.685019 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:50.685019 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:50.685019 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:50.685019 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:50.685019 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:50.685019 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:50.685019 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:50.685019 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:50.685019 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:50.685019 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:50.685019 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:50.685019 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:50.685019 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:50.685019 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:50.685019 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:50.685814 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:50.685814 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:50.685814 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:50.685814 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:50.685814 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:50.685814 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:50.685814 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:50.685814 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:50.685814 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:50.685814 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:50.685814 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:39:50.685814 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:50.685814 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 269/540] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 27 09:39:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:50.685814 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d6c09-7edf-4de3-b9ea-6d6bca92ab93 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:50.760650 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe96fe9-bdb9-4ee5-8bec-9eddea7b1ac8 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:50.796992 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:50.821881 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e7888-1db5-4994-903e-4aaac6455034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:50.822904 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e7888-1db5-4994-903e-4aaac6455034 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:50.824023 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e7888-1db5-4994-903e-4aaac6455034 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:50.824462 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e7888-1db5-4994-903e-4aaac6455034 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:50.844023 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e7888-1db5-4994-903e-4aaac6455034 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:50.849651 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-817e7888-1db5-4994-903e-4aaac6455034 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:39:50.849651 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:50.849651 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:50.849651 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:50.849651 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:50.849651 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:50.849651 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:50.849651 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:50.849651 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:50.849651 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:50.849651 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:50.849651 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:50.849651 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:50.849651 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:50.849651 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:50.849651 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:50.851233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:50.851233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:50.851233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:50.851233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:50.851233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:50.851233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:50.851233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:50.851233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:50.851233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:50.851233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:50.851233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:50.851233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:50.851233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:50.851233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:50.851233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:50.851233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:50.852797 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:50.852797 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:50.852797 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:50.852797 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:50.852797 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:50.852797 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:50.852797 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:50.852797 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:50.852797 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:50.852797 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:50.852797 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:39:50.852797 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:50.855879 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 272/541] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 27 09:39:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:50.856828 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e7888-1db5-4994-903e-4aaac6455034 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:50.870627 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d6c09-7edf-4de3-b9ea-6d6bca92ab93 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:50.915532 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e95de-7b42-4adf-a8fb-8cf55781f3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:50.916521 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e95de-7b42-4adf-a8fb-8cf55781f3f2 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:50.916521 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e95de-7b42-4adf-a8fb-8cf55781f3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:50.916815 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e95de-7b42-4adf-a8fb-8cf55781f3f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:50.930029 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e95de-7b42-4adf-a8fb-8cf55781f3f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:50.935031 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-161e95de-7b42-4adf-a8fb-8cf55781f3f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:39:50.935031 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:50.935031 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:50.935031 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:50.935031 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:50.935031 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:50.935031 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:50.935031 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:50.935031 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:50.935031 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:50.935031 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:50.935031 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:50.935031 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:50.935031 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:50.935031 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:50.935031 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:50.936959 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:50.936959 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:50.936959 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:50.936959 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:50.936959 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:50.936959 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:50.936959 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:50.936959 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:50.936959 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:50.936959 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:50.936959 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:50.936959 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:50.936959 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:50.936959 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:50.936959 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:50.936959 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:50.939341 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:50.939341 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:50.939341 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:50.939341 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:50.939341 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:50.939341 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:50.939341 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:50.939341 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:50.939341 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:50.939341 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:50.939341 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:39:50.939341 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:50.939341 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 270/542] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 27 09:39:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:50.939341 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e95de-7b42-4adf-a8fb-8cf55781f3f2 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:50.980659 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:50.998929 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e7888-1db5-4994-903e-4aaac6455034 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:51.044341 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44ba95-6dbf-4d21-971e-b5f318cd5837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:51.045139 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44ba95-6dbf-4d21-971e-b5f318cd5837 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:51.045139 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44ba95-6dbf-4d21-971e-b5f318cd5837 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:51.045401 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44ba95-6dbf-4d21-971e-b5f318cd5837 None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:51.046084 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44ba95-6dbf-4d21-971e-b5f318cd5837 None admin] RBAC: Adding query filter params (name=service) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:51.046386 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44ba95-6dbf-4d21-971e-b5f318cd5837 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:51.047874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44ba95-6dbf-4d21-971e-b5f318cd5837 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:51.057268 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 273/543] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 27 09:39:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:51.057892 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44ba95-6dbf-4d21-971e-b5f318cd5837 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:51.068471 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e95de-7b42-4adf-a8fb-8cf55781f3f2 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:51.110260 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:51.112170 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233eaec9-e27b-4612-8810-99976f43a72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:51.112720 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233eaec9-e27b-4612-8810-99976f43a72c None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:51.113037 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233eaec9-e27b-4612-8810-99976f43a72c None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:51.113247 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233eaec9-e27b-4612-8810-99976f43a72c None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:51.113915 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233eaec9-e27b-4612-8810-99976f43a72c None admin] RBAC: Adding query filter params (name=service) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:51.114232 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233eaec9-e27b-4612-8810-99976f43a72c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:51.116243 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233eaec9-e27b-4612-8810-99976f43a72c None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:51.125567 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 271/544] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 27 09:39:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:51.126445 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233eaec9-e27b-4612-8810-99976f43a72c None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:51.189720 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44ba95-6dbf-4d21-971e-b5f318cd5837 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:51.236527 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:51.242503 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8f87d-8c15-488d-81f2-45d296877d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:51.243626 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8f87d-8c15-488d-81f2-45d296877d0c None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:51.244118 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8f87d-8c15-488d-81f2-45d296877d0c None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:51.244503 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8f87d-8c15-488d-81f2-45d296877d0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:51.244651 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233eaec9-e27b-4612-8810-99976f43a72c None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:51.263392 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8f87d-8c15-488d-81f2-45d296877d0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:51.273764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-12f8f87d-8c15-488d-81f2-45d296877d0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:39:51.273764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:51.273764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:51.273764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:51.273764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:51.273764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:51.273764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:51.273764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:51.273764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:51.273764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:51.273764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:51.273764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:51.273764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:51.273764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:51.273764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:51.273764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:51.274706 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:51.274706 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:51.274706 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:51.274706 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:51.274706 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:51.274706 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:51.274706 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:51.274706 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:51.274706 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:51.274706 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:51.274706 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:51.274706 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:51.274706 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:51.274706 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:51.274706 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:51.274706 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:51.275547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:51.275547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:51.275547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:51.275547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:51.275547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:51.275547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:51.275547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:51.275547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:51.275547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:51.275547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:51.275547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:39:51.275547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:51.276135 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 274/545] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 27 09:39:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:51.277354 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8f87d-8c15-488d-81f2-45d296877d0c None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:51.285419 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e722431-fb47-4108-b92d-b919cb18d366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:51.286885 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e722431-fb47-4108-b92d-b919cb18d366 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:51.287624 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e722431-fb47-4108-b92d-b919cb18d366 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:51.287838 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e722431-fb47-4108-b92d-b919cb18d366 None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:51.289090 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e722431-fb47-4108-b92d-b919cb18d366 None admin] RBAC: Adding query filter params (name=service) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:51.289629 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e722431-fb47-4108-b92d-b919cb18d366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:51.292298 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e722431-fb47-4108-b92d-b919cb18d366 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:51.306900 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 272/546] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 27 09:39:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:51.308459 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e722431-fb47-4108-b92d-b919cb18d366 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:51.411366 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8f87d-8c15-488d-81f2-45d296877d0c None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:51.414859 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:51.437688 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e722431-fb47-4108-b92d-b919cb18d366 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:51.454557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69121f5-cde4-46be-9664-fc65feb123d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:51.455234 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69121f5-cde4-46be-9664-fc65feb123d7 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:51.455506 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69121f5-cde4-46be-9664-fc65feb123d7 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:51.455779 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69121f5-cde4-46be-9664-fc65feb123d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:51.467921 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69121f5-cde4-46be-9664-fc65feb123d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:51.469401 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69121f5-cde4-46be-9664-fc65feb123d7 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:51.476971 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1beaf-f346-4612-889b-69e994d5551f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:51.477625 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1beaf-f346-4612-889b-69e994d5551f None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:51.477904 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1beaf-f346-4612-889b-69e994d5551f None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:51.478174 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1beaf-f346-4612-889b-69e994d5551f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:51.489951 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1beaf-f346-4612-889b-69e994d5551f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:51.490669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-e69121f5-cde4-46be-9664-fc65feb123d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:51.490669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:51.490669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:51.490669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:51.490669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:51.490669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:51.490669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:51.490669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:51.490669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:51.490669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:51.490669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:51.490669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:51.490669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:39:51.490669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:39:51.490669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:39:51.490669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:39:51.492019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:51.492019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:51.492019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:51.492019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:51.492019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:51.492019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:51.492019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:51.492019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:51.492019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:51.492019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:51.492019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:51.492019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:51.492019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:51.492019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:51.492019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:51.492019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:51.492019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:39:51.493727 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:39:51.493727 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:51.493727 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:51.493983 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1beaf-f346-4612-889b-69e994d5551f None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:51.494111 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 275/547] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:51.494111 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69121f5-cde4-46be-9664-fc65feb123d7 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:51.513117 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-7fc1beaf-f346-4612-889b-69e994d5551f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:51.513117 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:51.513117 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:51.513117 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:51.513117 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:51.513117 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:51.513117 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:51.513117 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:51.513117 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:51.513117 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:51.513117 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:51.513117 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:51.513117 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:39:51.513117 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:39:51.513117 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:39:51.513117 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:39:51.519387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:51.519387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:51.519387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:51.519387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:51.519387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:51.519387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:51.519387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:51.519387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:51.519387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:51.519387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:51.519387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:51.519387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:51.519387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:51.519387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:51.519387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:51.519387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:51.519387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:39:51.520263 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:39:51.520263 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:51.520263 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:51.520263 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 273/548] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:51.520263 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1beaf-f346-4612-889b-69e994d5551f None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:51.534041 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:51.625887 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69121f5-cde4-46be-9664-fc65feb123d7 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:51.652657 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1beaf-f346-4612-889b-69e994d5551f None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:51.674401 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c754fd-233b-43a6-8275-13e2c9ea58a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:51.675078 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c754fd-233b-43a6-8275-13e2c9ea58a0 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:51.675361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c754fd-233b-43a6-8275-13e2c9ea58a0 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:51.675640 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c754fd-233b-43a6-8275-13e2c9ea58a0 None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:51.676333 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c754fd-233b-43a6-8275-13e2c9ea58a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:51.676635 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c754fd-233b-43a6-8275-13e2c9ea58a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:51.678190 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c754fd-233b-43a6-8275-13e2c9ea58a0 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:51.687495 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 276/549] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 27 09:39:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:51.688421 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c754fd-233b-43a6-8275-13e2c9ea58a0 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:51.712521 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1699236-eab0-49cf-bd5d-05b3fd4c3a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:51.713189 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1699236-eab0-49cf-bd5d-05b3fd4c3a87 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:51.713464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1699236-eab0-49cf-bd5d-05b3fd4c3a87 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:51.713715 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1699236-eab0-49cf-bd5d-05b3fd4c3a87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:51.715964 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:51.728932 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1699236-eab0-49cf-bd5d-05b3fd4c3a87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:51.730714 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1699236-eab0-49cf-bd5d-05b3fd4c3a87 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:51.749981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-d1699236-eab0-49cf-bd5d-05b3fd4c3a87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:51.749981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:51.749981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:51.749981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:51.749981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:51.749981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:51.749981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:51.749981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:51.749981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:51.749981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:51.749981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:51.749981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:51.749981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:39:51.749981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:39:51.749981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:39:51.749981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:39:51.751652 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:51.751652 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:51.751652 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:51.751652 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:51.751652 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:51.751652 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:51.751652 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:51.751652 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:51.751652 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:51.751652 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:51.751652 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:51.751652 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:51.751652 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:51.751652 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:51.751652 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:51.751652 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:51.751652 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:39:51.754225 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:39:51.754225 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:51.754225 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:51.754225 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 274/550] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:51.754225 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1699236-eab0-49cf-bd5d-05b3fd4c3a87 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:51.829650 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:51.855397 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c754fd-233b-43a6-8275-13e2c9ea58a0 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:51.892496 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f93372-74dd-47aa-b5fd-793f3bcb8294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:51.893127 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f93372-74dd-47aa-b5fd-793f3bcb8294 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:51.893393 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f93372-74dd-47aa-b5fd-793f3bcb8294 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:51.893643 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f93372-74dd-47aa-b5fd-793f3bcb8294 None admin] PATH_INFO: `/v3/domains` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:51.894295 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f93372-74dd-47aa-b5fd-793f3bcb8294 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:51.894596 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f93372-74dd-47aa-b5fd-793f3bcb8294 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:51.896477 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f93372-74dd-47aa-b5fd-793f3bcb8294 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:51.897638 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1699236-eab0-49cf-bd5d-05b3fd4c3a87 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:51.919434 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 277/551] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:51.920951 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f93372-74dd-47aa-b5fd-793f3bcb8294 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:51.946478 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9aa93-a53d-4649-b1ee-63ad7d0658fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:51.947468 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9aa93-a53d-4649-b1ee-63ad7d0658fe None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:51.947837 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9aa93-a53d-4649-b1ee-63ad7d0658fe None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:51.948225 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9aa93-a53d-4649-b1ee-63ad7d0658fe None admin] PATH_INFO: `/v3/domains` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:51.949156 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9aa93-a53d-4649-b1ee-63ad7d0658fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:51.949543 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9aa93-a53d-4649-b1ee-63ad7d0658fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:51.951306 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9aa93-a53d-4649-b1ee-63ad7d0658fe None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:51.967923 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 275/552] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:51.969322 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9aa93-a53d-4649-b1ee-63ad7d0658fe None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:52.020121 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:52.052687 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f93372-74dd-47aa-b5fd-793f3bcb8294 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:52.098233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc99ca-e63a-4da3-945c-6c660eeebb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:52.099471 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc99ca-e63a-4da3-945c-6c660eeebb7d None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:52.099938 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc99ca-e63a-4da3-945c-6c660eeebb7d None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:52.100415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc99ca-e63a-4da3-945c-6c660eeebb7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:52.101252 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9aa93-a53d-4649-b1ee-63ad7d0658fe None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:52.118652 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc99ca-e63a-4da3-945c-6c660eeebb7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:52.120094 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc99ca-e63a-4da3-945c-6c660eeebb7d None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:52.128064 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:52.136174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-8acc99ca-e63a-4da3-945c-6c660eeebb7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:52.136174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:52.136174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:52.136174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:52.136174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:52.136174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:52.136174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:52.136174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:52.136174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:52.136174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:52.136174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:52.136174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:52.136174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:39:52.136174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:39:52.136174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:39:52.136174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:39:52.138547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:52.138547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:52.138547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:52.138547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:52.138547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:52.138547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:52.138547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:52.138547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:52.138547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:52.138547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:52.138547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:52.138547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:52.138547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:52.138547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:52.138547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:52.138547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:52.138547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:39:52.140461 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:39:52.140461 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:52.140461 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:52.140461 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 278/553] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:52.140461 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc99ca-e63a-4da3-945c-6c660eeebb7d None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:52.147065 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640125cb-e22e-4d7b-ac34-2d68d204cd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:52.147694 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640125cb-e22e-4d7b-ac34-2d68d204cd04 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:52.147974 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640125cb-e22e-4d7b-ac34-2d68d204cd04 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:52.148246 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640125cb-e22e-4d7b-ac34-2d68d204cd04 None admin] PATH_INFO: `/v3/domains` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:52.148913 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640125cb-e22e-4d7b-ac34-2d68d204cd04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:52.149216 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640125cb-e22e-4d7b-ac34-2d68d204cd04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:52.150619 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640125cb-e22e-4d7b-ac34-2d68d204cd04 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:52.163458 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 276/554] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:52.164341 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640125cb-e22e-4d7b-ac34-2d68d204cd04 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:52.269527 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc99ca-e63a-4da3-945c-6c660eeebb7d None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:52.299578 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640125cb-e22e-4d7b-ac34-2d68d204cd04 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:52.316270 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:52.329436 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005b0c7-6f48-461e-8240-fe491273d50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:52.330242 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005b0c7-6f48-461e-8240-fe491273d50c None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:52.330622 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005b0c7-6f48-461e-8240-fe491273d50c None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:52.331121 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005b0c7-6f48-461e-8240-fe491273d50c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:52.341554 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005b0c7-6f48-461e-8240-fe491273d50c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:52.343307 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005b0c7-6f48-461e-8240-fe491273d50c None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:52.348944 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179875a0-b7a2-411f-9995-c229e61866c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:52.349711 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179875a0-b7a2-411f-9995-c229e61866c4 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:52.350081 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179875a0-b7a2-411f-9995-c229e61866c4 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:52.350443 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179875a0-b7a2-411f-9995-c229e61866c4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:52.357540 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-e005b0c7-6f48-461e-8240-fe491273d50c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 27 09:39:52.357540 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:52.357540 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:52.357540 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:52.357540 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:52.357540 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:52.357540 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:52.357540 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:52.357540 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:52.357540 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:52.357540 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:52.357540 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:52.357540 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 09:39:52.357540 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 09:39:52.357540 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 09:39:52.357540 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 09:39:52.359601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:52.359601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:52.359601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 09:39:52.359601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:39:52.359601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 09:39:52.359601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:39:52.359601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:52.359601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:52.359601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:52.359601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:52.359601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:52.359601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:52.359601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:52.359601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:52.359601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:52.359601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:52.359601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:52.359601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:52.360562 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:52.360562 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:52.360562 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 09:39:52.360562 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 09:39:52.360562 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 09:39:52.360562 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 09:39:52.360562 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 09:39:52.360562 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 09:39:52.360562 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 27 09:39:52.360562 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:52.360562 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 279/555] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 27 09:39:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:52.361134 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005b0c7-6f48-461e-8240-fe491273d50c None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:52.368476 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179875a0-b7a2-411f-9995-c229e61866c4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:52.370190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179875a0-b7a2-411f-9995-c229e61866c4 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:52.384988 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-179875a0-b7a2-411f-9995-c229e61866c4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 09:39:52.384988 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:52.384988 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:52.384988 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:52.384988 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:52.384988 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:52.384988 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:52.384988 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:52.384988 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:52.384988 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:52.384988 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:52.384988 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:52.384988 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 09:39:52.384988 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 09:39:52.384988 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 09:39:52.384988 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 09:39:52.386150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:52.386150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:52.386150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 09:39:52.386150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:39:52.386150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 09:39:52.386150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:39:52.386150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:52.386150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:52.386150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:52.386150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:52.386150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:52.386150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:52.386150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:52.386150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:52.386150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:52.386150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:52.386150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:52.386150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:52.387077 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:52.387077 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:52.387077 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 09:39:52.387077 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 09:39:52.387077 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 09:39:52.387077 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 09:39:52.387077 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 09:39:52.387077 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 09:39:52.387077 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 09:39:52.387077 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:52.387077 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 277/556] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:39:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:52.387752 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179875a0-b7a2-411f-9995-c229e61866c4 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:52.436479 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:52.501160 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179875a0-b7a2-411f-9995-c229e61866c4 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:52.529038 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005b0c7-6f48-461e-8240-fe491273d50c None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:52.550623 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bde27-053a-417d-ade0-bf9578783ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:52.551335 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bde27-053a-417d-ade0-bf9578783ef5 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:52.551614 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bde27-053a-417d-ade0-bf9578783ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:52.551887 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bde27-053a-417d-ade0-bf9578783ef5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:52.561535 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080bde27-053a-417d-ade0-bf9578783ef5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:52.563141 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080bde27-053a-417d-ade0-bf9578783ef5 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:52.576836 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-080bde27-053a-417d-ade0-bf9578783ef5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 09:39:52.576836 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:52.576836 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:52.576836 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:52.576836 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:52.576836 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:52.576836 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:52.576836 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:52.576836 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:52.576836 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:52.576836 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:52.576836 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:52.576836 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 09:39:52.576836 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 09:39:52.576836 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 09:39:52.576836 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 09:39:52.579405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:52.579405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:52.579405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 09:39:52.579405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:39:52.579405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 09:39:52.579405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:39:52.579405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:52.579405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:52.579405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:52.579405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:52.579405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:52.579405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:52.579405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:52.579405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:52.579405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:52.579405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:52.579405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:52.579405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:52.581352 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:52.581352 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:52.581352 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 09:39:52.581352 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 09:39:52.581352 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 09:39:52.581352 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 09:39:52.581352 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 09:39:52.581352 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 09:39:52.581352 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 09:39:52.581352 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:52.581352 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 278/557] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Sep 27 09:39:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:52.581352 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bde27-053a-417d-ade0-bf9578783ef5 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:52.586816 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9aa255-a949-41ef-96e6-2fae41a6edd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:52.587742 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9aa255-a949-41ef-96e6-2fae41a6edd3 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:52.589590 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9aa255-a949-41ef-96e6-2fae41a6edd3 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:52.589590 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9aa255-a949-41ef-96e6-2fae41a6edd3 None admin] PATH_INFO: `/v3/domains` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:52.590029 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9aa255-a949-41ef-96e6-2fae41a6edd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:52.590500 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9aa255-a949-41ef-96e6-2fae41a6edd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:52.592167 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9aa255-a949-41ef-96e6-2fae41a6edd3 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:52.607555 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 280/558] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:52.609085 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9aa255-a949-41ef-96e6-2fae41a6edd3 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:52.680948 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:52.726489 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bde27-053a-417d-ade0-bf9578783ef5 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:52.729632 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:52.757182 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9aa255-a949-41ef-96e6-2fae41a6edd3 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:52.774076 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7355ff-5c2a-4435-9b6f-1304aa133858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:52.774700 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7355ff-5c2a-4435-9b6f-1304aa133858 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:52.775010 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7355ff-5c2a-4435-9b6f-1304aa133858 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:52.775273 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7355ff-5c2a-4435-9b6f-1304aa133858 None admin] PATH_INFO: `/v3/users` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:52.776020 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7355ff-5c2a-4435-9b6f-1304aa133858 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:52.776319 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7355ff-5c2a-4435-9b6f-1304aa133858 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:52.777824 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7355ff-5c2a-4435-9b6f-1304aa133858 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:52.797325 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676f820-9141-45f8-a1b2-9aa604571c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:52.797948 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676f820-9141-45f8-a1b2-9aa604571c8e None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:52.798097 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 279/559] 10.222.0.49 () {56 vars in 1139 bytes} [Tue Sep 27 09:39:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:52.798224 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676f820-9141-45f8-a1b2-9aa604571c8e None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:52.798472 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676f820-9141-45f8-a1b2-9aa604571c8e None admin] PATH_INFO: `/v3/users` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:52.798901 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7355ff-5c2a-4435-9b6f-1304aa133858 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:52.799353 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676f820-9141-45f8-a1b2-9aa604571c8e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:52.799556 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676f820-9141-45f8-a1b2-9aa604571c8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:52.801097 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676f820-9141-45f8-a1b2-9aa604571c8e None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:52.822695 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 281/560] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Sep 27 09:39:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:52.823671 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676f820-9141-45f8-a1b2-9aa604571c8e None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:52.937429 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7355ff-5c2a-4435-9b6f-1304aa133858 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:52.949654 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676f820-9141-45f8-a1b2-9aa604571c8e None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:52.959655 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:52.989328 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6140f-a05e-478e-abcf-afbf667ce90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:52.990616 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6140f-a05e-478e-abcf-afbf667ce90d None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:52.991046 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6140f-a05e-478e-abcf-afbf667ce90d None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:52.991399 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6140f-a05e-478e-abcf-afbf667ce90d None admin] PATH_INFO: `/v3/users` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:52.992251 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6140f-a05e-478e-abcf-afbf667ce90d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:52.992637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6140f-a05e-478e-abcf-afbf667ce90d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:52.992898 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391d5e5-d308-4b41-83e2-ffd8ee37b923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:52.993558 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391d5e5-d308-4b41-83e2-ffd8ee37b923 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:52.993835 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391d5e5-d308-4b41-83e2-ffd8ee37b923 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:52.994105 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391d5e5-d308-4b41-83e2-ffd8ee37b923 None admin] PATH_INFO: `/v3/users/glance` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:52.994622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6140f-a05e-478e-abcf-afbf667ce90d None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:53.003105 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391d5e5-d308-4b41-83e2-ffd8ee37b923 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:53.004632 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391d5e5-d308-4b41-83e2-ffd8ee37b923 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:53.022565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 280/561] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Sep 27 09:39:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:53.024019 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6140f-a05e-478e-abcf-afbf667ce90d None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:53.025743 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-1391d5e5-d308-4b41-83e2-ffd8ee37b923 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 27 09:39:53.025743 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:53.025743 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:53.025743 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:53.025743 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:53.025743 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:53.025743 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:53.025743 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:53.025743 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:53.025743 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:53.025743 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:53.025743 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:53.025743 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 09:39:53.025743 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 09:39:53.025743 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 09:39:53.025743 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 09:39:53.028647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:53.028647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:53.028647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 09:39:53.028647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:39:53.028647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 09:39:53.028647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:39:53.028647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:53.028647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:53.028647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:53.028647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:53.028647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:53.028647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:53.028647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:53.028647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:53.028647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:53.028647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:53.028647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:53.028647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:53.031879 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:53.031879 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:53.031879 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 09:39:53.031879 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 09:39:53.031879 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 09:39:53.031879 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 09:39:53.031879 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 09:39:53.031879 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 09:39:53.031879 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 27 09:39:53.031879 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:53.031879 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 282/562] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:39:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:53.031879 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391d5e5-d308-4b41-83e2-ffd8ee37b923 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:53.054621 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:53.163826 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6140f-a05e-478e-abcf-afbf667ce90d None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:53.173152 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391d5e5-d308-4b41-83e2-ffd8ee37b923 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:53.206722 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f6b40-f671-4a47-8b39-60b1f1fe2a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:53.207562 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f6b40-f671-4a47-8b39-60b1f1fe2a12 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:53.208007 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f6b40-f671-4a47-8b39-60b1f1fe2a12 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:53.208425 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f6b40-f671-4a47-8b39-60b1f1fe2a12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:53.219996 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f6b40-f671-4a47-8b39-60b1f1fe2a12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:53.220576 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666cc7b-fdcc-463e-983f-0b7a79ec1f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:53.221328 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666cc7b-fdcc-463e-983f-0b7a79ec1f80 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:53.221493 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f6b40-f671-4a47-8b39-60b1f1fe2a12 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:53.221772 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666cc7b-fdcc-463e-983f-0b7a79ec1f80 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:53.222153 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666cc7b-fdcc-463e-983f-0b7a79ec1f80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:53.234849 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666cc7b-fdcc-463e-983f-0b7a79ec1f80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:53.236521 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666cc7b-fdcc-463e-983f-0b7a79ec1f80 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:53.237283 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-309f6b40-f671-4a47-8b39-60b1f1fe2a12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:53.237283 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:53.237283 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:53.237283 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:53.237283 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:53.237283 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:53.237283 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:53.237283 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:53.237283 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:53.237283 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:53.237283 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:53.237283 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:53.237283 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:39:53.237283 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:39:53.237283 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:39:53.237283 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:39:53.239125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:53.239125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:53.239125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:53.239125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:53.239125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:53.239125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:53.239125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:53.239125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:53.239125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:53.239125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:53.239125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:53.239125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:53.239125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:53.239125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:53.239125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:53.239125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:53.239125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:39:53.244401 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:39:53.244401 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:53.244401 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:53.244401 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 281/563] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:53.244401 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f6b40-f671-4a47-8b39-60b1f1fe2a12 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:53.258417 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-0666cc7b-fdcc-463e-983f-0b7a79ec1f80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:53.258417 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:53.258417 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:53.258417 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:53.258417 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:53.258417 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:53.258417 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:53.258417 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:53.258417 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:53.258417 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:53.258417 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:53.258417 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:53.258417 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:39:53.258417 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:39:53.258417 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:39:53.258417 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:39:53.260410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:53.260410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:53.260410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:53.260410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:53.260410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:53.260410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:53.260410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:53.260410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:53.260410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:53.260410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:53.260410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:53.260410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:53.260410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:53.260410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:53.260410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:53.260410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:53.260410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:39:53.262827 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:39:53.262827 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:53.262827 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:53.262827 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 283/564] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:53.262827 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666cc7b-fdcc-463e-983f-0b7a79ec1f80 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:53.290657 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:53.329779 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:53.373903 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f6b40-f671-4a47-8b39-60b1f1fe2a12 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:53.394124 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666cc7b-fdcc-463e-983f-0b7a79ec1f80 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:53.419542 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40645b7c-f3ea-4e73-86fb-c3d11e58754c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:53.420471 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40645b7c-f3ea-4e73-86fb-c3d11e58754c None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:53.420916 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40645b7c-f3ea-4e73-86fb-c3d11e58754c None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:53.421372 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40645b7c-f3ea-4e73-86fb-c3d11e58754c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:53.438455 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40645b7c-f3ea-4e73-86fb-c3d11e58754c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:53.441024 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40645b7c-f3ea-4e73-86fb-c3d11e58754c None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:53.445831 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaca255-a5ef-4153-bb8c-b2f555e6053a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:53.446797 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaca255-a5ef-4153-bb8c-b2f555e6053a None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:53.447233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaca255-a5ef-4153-bb8c-b2f555e6053a None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:53.447659 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaca255-a5ef-4153-bb8c-b2f555e6053a None admin] PATH_INFO: `/v3/users` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:53.448872 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaca255-a5ef-4153-bb8c-b2f555e6053a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:53.449370 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaca255-a5ef-4153-bb8c-b2f555e6053a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:53.451970 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaca255-a5ef-4153-bb8c-b2f555e6053a None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:53.465993 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-40645b7c-f3ea-4e73-86fb-c3d11e58754c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:53.465993 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:53.465993 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:53.465993 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:53.465993 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:53.465993 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:53.465993 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:53.465993 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:53.465993 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:53.465993 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:53.465993 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:53.465993 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:53.465993 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:39:53.465993 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:39:53.465993 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:39:53.465993 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:39:53.467385 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:53.467385 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:53.467385 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:53.467385 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:53.467385 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:53.467385 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:53.467385 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:53.467385 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:53.467385 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:53.467385 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:53.467385 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:53.467385 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:53.467385 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:53.467385 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:53.467385 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:53.467385 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:53.467385 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:39:53.468813 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:39:53.468813 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:53.468813 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:53.468813 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 282/565] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:53.468813 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40645b7c-f3ea-4e73-86fb-c3d11e58754c None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:53.488007 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 284/566] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Sep 27 09:39:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:53.489706 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaca255-a5ef-4153-bb8c-b2f555e6053a None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:53.601955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:53.610852 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40645b7c-f3ea-4e73-86fb-c3d11e58754c None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:53.639307 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaca255-a5ef-4153-bb8c-b2f555e6053a None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:53.648846 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:53.666671 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e06f7-0c3c-4f7b-8f9d-2bd4d68f7fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:53.667661 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e06f7-0c3c-4f7b-8f9d-2bd4d68f7fe1 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:53.668104 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e06f7-0c3c-4f7b-8f9d-2bd4d68f7fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:53.668539 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e06f7-0c3c-4f7b-8f9d-2bd4d68f7fe1 None admin] PATH_INFO: `/v3/domains` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:53.669601 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e06f7-0c3c-4f7b-8f9d-2bd4d68f7fe1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:53.670089 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e06f7-0c3c-4f7b-8f9d-2bd4d68f7fe1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:53.672442 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e06f7-0c3c-4f7b-8f9d-2bd4d68f7fe1 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:53.686856 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 283/567] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:53.688547 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e06f7-0c3c-4f7b-8f9d-2bd4d68f7fe1 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:53.688703 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dee71b-f7c9-452a-b0ba-4f7fea825ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:53.689284 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dee71b-f7c9-452a-b0ba-4f7fea825ca3 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:53.689586 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dee71b-f7c9-452a-b0ba-4f7fea825ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:53.689876 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dee71b-f7c9-452a-b0ba-4f7fea825ca3 None admin] PATH_INFO: `/v3/domains` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:53.690619 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dee71b-f7c9-452a-b0ba-4f7fea825ca3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:53.691023 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dee71b-f7c9-452a-b0ba-4f7fea825ca3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:53.692728 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dee71b-f7c9-452a-b0ba-4f7fea825ca3 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:53.706955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 285/568] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:53.708032 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dee71b-f7c9-452a-b0ba-4f7fea825ca3 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:53.836768 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e06f7-0c3c-4f7b-8f9d-2bd4d68f7fe1 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:53.849111 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dee71b-f7c9-452a-b0ba-4f7fea825ca3 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:53.887178 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75d214-4975-48c7-829f-ad77e03dd63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:53.888146 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75d214-4975-48c7-829f-ad77e03dd63d None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:53.888589 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75d214-4975-48c7-829f-ad77e03dd63d None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:53.889026 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75d214-4975-48c7-829f-ad77e03dd63d None admin] PATH_INFO: `/v3/domains` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:53.889969 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf75d214-4975-48c7-829f-ad77e03dd63d None admin] RBAC: Adding query filter params (name=Default) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:53.890456 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf75d214-4975-48c7-829f-ad77e03dd63d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:53.892873 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf75d214-4975-48c7-829f-ad77e03dd63d None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:53.896607 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082a626-8fb4-4759-b0d1-912cad8a6c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:53.897355 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082a626-8fb4-4759-b0d1-912cad8a6c75 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:53.897638 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082a626-8fb4-4759-b0d1-912cad8a6c75 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:53.897905 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082a626-8fb4-4759-b0d1-912cad8a6c75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:53.901404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:53.910202 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 284/569] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:53.912141 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75d214-4975-48c7-829f-ad77e03dd63d None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:53.915309 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082a626-8fb4-4759-b0d1-912cad8a6c75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:53.916844 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082a626-8fb4-4759-b0d1-912cad8a6c75 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:53.935578 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-e082a626-8fb4-4759-b0d1-912cad8a6c75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:53.935578 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:53.935578 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:53.935578 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:53.935578 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:53.935578 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:53.935578 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:53.935578 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:53.935578 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:53.935578 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:53.935578 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:53.935578 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:53.935578 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:39:53.935578 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:39:53.935578 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:39:53.935578 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:39:53.937075 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:53.937075 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:53.937075 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:53.937075 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:53.937075 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:53.937075 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:53.937075 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:53.937075 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:53.937075 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:53.937075 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:53.937075 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:53.937075 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:53.937075 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:53.937075 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:53.937075 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:53.937075 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:53.937075 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:39:53.939457 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:39:53.939457 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:53.939457 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:53.939457 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 286/570] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:53.939457 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082a626-8fb4-4759-b0d1-912cad8a6c75 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:53.975675 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:54.041972 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75d214-4975-48c7-829f-ad77e03dd63d None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:54.065208 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082a626-8fb4-4759-b0d1-912cad8a6c75 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:54.085057 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f128ab9-4b47-404c-b933-aea51c31ae5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:54.085803 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f128ab9-4b47-404c-b933-aea51c31ae5e None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:54.086139 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f128ab9-4b47-404c-b933-aea51c31ae5e None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:54.086470 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f128ab9-4b47-404c-b933-aea51c31ae5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:54.095800 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f128ab9-4b47-404c-b933-aea51c31ae5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:54.098047 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f128ab9-4b47-404c-b933-aea51c31ae5e None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:54.109558 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73d01a-492e-4ca3-ae79-7f435e6bd9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:54.110553 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73d01a-492e-4ca3-ae79-7f435e6bd9f7 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:54.111051 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73d01a-492e-4ca3-ae79-7f435e6bd9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:54.111483 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73d01a-492e-4ca3-ae79-7f435e6bd9f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:54.118094 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-3f128ab9-4b47-404c-b933-aea51c31ae5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:39:54.118094 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:54.118094 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:54.118094 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:54.118094 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:54.118094 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:54.118094 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:54.118094 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:54.118094 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:54.118094 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:54.118094 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:54.118094 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:54.118094 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 09:39:54.118094 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 09:39:54.118094 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 09:39:54.119332 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 09:39:54.119332 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:54.119332 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:54.119332 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:54.119332 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:54.119332 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:54.119332 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:54.119332 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:54.119332 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:54.119332 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:54.119332 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:54.119332 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:54.119332 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:54.119332 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:54.119332 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:54.119332 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:54.119332 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:54.120510 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 09:39:54.120510 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 09:39:54.120510 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 09:39:54.120510 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 09:39:54.120510 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 09:39:54.120510 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 09:39:54.120510 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:39:54.120510 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:54.120510 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 285/571] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:39:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:54.121398 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f128ab9-4b47-404c-b933-aea51c31ae5e None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:54.123201 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73d01a-492e-4ca3-ae79-7f435e6bd9f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:54.124692 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73d01a-492e-4ca3-ae79-7f435e6bd9f7 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:54.144177 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-ea73d01a-492e-4ca3-ae79-7f435e6bd9f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:39:54.144177 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:54.144177 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:54.144177 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:54.144177 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:54.144177 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:54.144177 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:54.144177 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:54.144177 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:54.144177 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:54.144177 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:54.144177 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:54.144177 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 09:39:54.144177 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 09:39:54.144177 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 09:39:54.152172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 09:39:54.152172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:54.152172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:54.152172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:54.152172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:54.152172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:54.152172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:54.152172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:54.152172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:54.152172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:54.152172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:54.152172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:54.152172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:54.152172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:54.152172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:54.152172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:54.152172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:54.154246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 09:39:54.154246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 09:39:54.154246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 09:39:54.154246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 09:39:54.154246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 09:39:54.154246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 09:39:54.154246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:39:54.154246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:54.154246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 287/572] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:39:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:54.154246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73d01a-492e-4ca3-ae79-7f435e6bd9f7 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:54.222787 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:54.267761 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f128ab9-4b47-404c-b933-aea51c31ae5e None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:54.269660 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:54.290451 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73d01a-492e-4ca3-ae79-7f435e6bd9f7 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:54.320354 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a561d-c516-4e55-bef2-1eb66faae512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:54.321179 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a561d-c516-4e55-bef2-1eb66faae512 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:54.321495 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a561d-c516-4e55-bef2-1eb66faae512 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:54.321805 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a561d-c516-4e55-bef2-1eb66faae512 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:54.330552 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a561d-c516-4e55-bef2-1eb66faae512 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:54.332592 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a561d-c516-4e55-bef2-1eb66faae512 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:54.337789 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe0f05-a817-4a7f-b7bd-25c80ec7e131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:54.338479 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe0f05-a817-4a7f-b7bd-25c80ec7e131 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:54.338848 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe0f05-a817-4a7f-b7bd-25c80ec7e131 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:54.339194 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe0f05-a817-4a7f-b7bd-25c80ec7e131 None admin] PATH_INFO: `/v3/domains` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:54.339914 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe0f05-a817-4a7f-b7bd-25c80ec7e131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:54.340272 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe0f05-a817-4a7f-b7bd-25c80ec7e131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:54.341740 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe0f05-a817-4a7f-b7bd-25c80ec7e131 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:54.347076 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-203a561d-c516-4e55-bef2-1eb66faae512 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:39:54.347076 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:54.347076 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:54.347076 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:54.347076 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:54.347076 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:54.347076 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:54.347076 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:54.347076 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:54.347076 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:54.347076 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:54.347076 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:54.347076 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 09:39:54.347076 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 09:39:54.347076 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 09:39:54.348701 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 09:39:54.348701 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:54.348701 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:54.348701 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:54.348701 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:54.348701 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:54.348701 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:54.348701 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:54.348701 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:54.348701 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:54.348701 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:54.348701 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:54.348701 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:54.348701 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:54.348701 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:54.348701 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:54.348701 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:54.351839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 09:39:54.351839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 09:39:54.351839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 09:39:54.351839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 09:39:54.351839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 09:39:54.351839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 09:39:54.351839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:39:54.351839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:54.351839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 286/573] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:39:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:54.351839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a561d-c516-4e55-bef2-1eb66faae512 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:54.362135 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 288/574] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:54.369007 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe0f05-a817-4a7f-b7bd-25c80ec7e131 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:54.482535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe0f05-a817-4a7f-b7bd-25c80ec7e131 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:54.493618 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:54.500760 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a561d-c516-4e55-bef2-1eb66faae512 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:54.522051 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409d2c7-88e1-4f19-a9da-4e8e7598631f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:54.522675 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409d2c7-88e1-4f19-a9da-4e8e7598631f None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:54.522997 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409d2c7-88e1-4f19-a9da-4e8e7598631f None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:54.523263 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409d2c7-88e1-4f19-a9da-4e8e7598631f None admin] PATH_INFO: `/v3/projects` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:54.523967 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409d2c7-88e1-4f19-a9da-4e8e7598631f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:54.524265 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409d2c7-88e1-4f19-a9da-4e8e7598631f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:54.525722 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409d2c7-88e1-4f19-a9da-4e8e7598631f None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:54.539339 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 289/575] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 27 09:39:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:54.540215 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409d2c7-88e1-4f19-a9da-4e8e7598631f None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:54.550450 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39368088-c34d-4bc3-aef9-80b55a038281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:54.551114 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39368088-c34d-4bc3-aef9-80b55a038281 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:54.551411 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39368088-c34d-4bc3-aef9-80b55a038281 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:54.551659 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39368088-c34d-4bc3-aef9-80b55a038281 None admin] PATH_INFO: `/v3/projects` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:54.552461 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39368088-c34d-4bc3-aef9-80b55a038281 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:54.552763 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39368088-c34d-4bc3-aef9-80b55a038281 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:54.554392 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39368088-c34d-4bc3-aef9-80b55a038281 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:54.583478 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 287/576] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 27 09:39:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:54.583478 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39368088-c34d-4bc3-aef9-80b55a038281 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:54.617220 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:54.678944 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409d2c7-88e1-4f19-a9da-4e8e7598631f None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:54.730874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbaa657-4770-4a17-8ff5-2a816bf47c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:54.731856 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbaa657-4770-4a17-8ff5-2a816bf47c0d None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:54.731996 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39368088-c34d-4bc3-aef9-80b55a038281 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:54.732287 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbaa657-4770-4a17-8ff5-2a816bf47c0d None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:54.732706 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbaa657-4770-4a17-8ff5-2a816bf47c0d None admin] PATH_INFO: `/v3/projects` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:54.733835 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbaa657-4770-4a17-8ff5-2a816bf47c0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:54.734320 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbaa657-4770-4a17-8ff5-2a816bf47c0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:54.736578 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbaa657-4770-4a17-8ff5-2a816bf47c0d None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:54.756698 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 290/577] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 27 09:39:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:54.757660 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbaa657-4770-4a17-8ff5-2a816bf47c0d None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:54.791000 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6da79f-c6dd-4066-8c39-1cba6161531b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:54.791950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6da79f-c6dd-4066-8c39-1cba6161531b None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:54.792383 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6da79f-c6dd-4066-8c39-1cba6161531b None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:54.792818 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6da79f-c6dd-4066-8c39-1cba6161531b None admin] PATH_INFO: `/v3/projects/service` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:54.794983 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:54.803889 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6da79f-c6dd-4066-8c39-1cba6161531b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:54.806439 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6da79f-c6dd-4066-8c39-1cba6161531b None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-de6da79f-c6dd-4066-8c39-1cba6161531b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:39:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 09:39:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 09:39:54.825308 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 09:39:54.826583 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 09:39:54.826583 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:54.826583 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:54.826583 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:54.826583 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:54.826583 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:54.826583 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:54.826583 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:54.826583 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:54.826583 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:54.826583 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:54.826583 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:54.826583 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:54.826583 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:54.826583 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:54.826583 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:54.826583 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:54.828039 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 09:39:54.828039 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 09:39:54.828039 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 09:39:54.828039 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 09:39:54.828039 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 09:39:54.828039 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 09:39:54.828039 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:39:54.828039 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:54.828039 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 288/578] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:39:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:54.828880 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6da79f-c6dd-4066-8c39-1cba6161531b None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:54.894581 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbaa657-4770-4a17-8ff5-2a816bf47c0d None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:54.936379 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:54.944817 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e1a85-33ad-4bc3-801d-27ed771cd3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:54.945697 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e1a85-33ad-4bc3-801d-27ed771cd3af None admin] REQUEST_METHOD: `PUT` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:54.946091 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e1a85-33ad-4bc3-801d-27ed771cd3af None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:54.946506 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e1a85-33ad-4bc3-801d-27ed771cd3af None admin] PATH_INFO: `/v3/projects/dbe5c492b05e40448942bb2500c185ee/users/25ffb8d1c3014daab3b00e2a059af76b/roles/a3ad332ff078405ebc48aa8df0035cab` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:54.963756 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6da79f-c6dd-4066-8c39-1cba6161531b None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:54.964043 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e1a85-33ad-4bc3-801d-27ed771cd3af None admin] RBAC: Authorizing `identity:create_grant(project_id=dbe5c492b05e40448942bb2500c185ee, user_id=25ffb8d1c3014daab3b00e2a059af76b, role_id=a3ad332ff078405ebc48aa8df0035cab)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:54.965677 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e1a85-33ad-4bc3-801d-27ed771cd3af None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:54.985179 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 291/579] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 27 09:39:54 2022] PUT /identity/v3/projects/dbe5c492b05e40448942bb2500c185ee/users/25ffb8d1c3014daab3b00e2a059af76b/roles/a3ad332ff078405ebc48aa8df0035cab => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 09:39:54.986176 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e1a85-33ad-4bc3-801d-27ed771cd3af None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:55.009812 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef5d07-1bfa-432c-bab5-aba25ebdfd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:55.010503 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef5d07-1bfa-432c-bab5-aba25ebdfd9a None admin] REQUEST_METHOD: `PUT` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:55.010798 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef5d07-1bfa-432c-bab5-aba25ebdfd9a None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:55.011082 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef5d07-1bfa-432c-bab5-aba25ebdfd9a None admin] PATH_INFO: `/v3/projects/dbe5c492b05e40448942bb2500c185ee/users/5a8283aa6cda48fa9a6b2f42fc498238/roles/a3ad332ff078405ebc48aa8df0035cab` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:55.032845 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef5d07-1bfa-432c-bab5-aba25ebdfd9a None admin] RBAC: Authorizing `identity:create_grant(project_id=dbe5c492b05e40448942bb2500c185ee, user_id=5a8283aa6cda48fa9a6b2f42fc498238, role_id=a3ad332ff078405ebc48aa8df0035cab)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:55.035922 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef5d07-1bfa-432c-bab5-aba25ebdfd9a None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:55.060052 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 289/580] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 27 09:39:54 2022] PUT /identity/v3/projects/dbe5c492b05e40448942bb2500c185ee/users/5a8283aa6cda48fa9a6b2f42fc498238/roles/a3ad332ff078405ebc48aa8df0035cab => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 09:39:55.061389 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef5d07-1bfa-432c-bab5-aba25ebdfd9a None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:55.118600 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:55.152148 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e1a85-33ad-4bc3-801d-27ed771cd3af None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:55.199720 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3429153-6f5d-4997-903b-0befb3faad85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:55.200432 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3429153-6f5d-4997-903b-0befb3faad85 None admin] REQUEST_METHOD: `PUT` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:55.200762 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3429153-6f5d-4997-903b-0befb3faad85 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:55.201040 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3429153-6f5d-4997-903b-0befb3faad85 None admin] PATH_INFO: `/v3/projects/dbe5c492b05e40448942bb2500c185ee/users/bda026ed208d4736938da05121a06f4e/roles/a3ad332ff078405ebc48aa8df0035cab` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:55.220296 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3429153-6f5d-4997-903b-0befb3faad85 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbe5c492b05e40448942bb2500c185ee, user_id=bda026ed208d4736938da05121a06f4e, role_id=a3ad332ff078405ebc48aa8df0035cab)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:55.221839 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3429153-6f5d-4997-903b-0befb3faad85 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:55.247865 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 292/581] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 27 09:39:54 2022] PUT /identity/v3/projects/dbe5c492b05e40448942bb2500c185ee/users/bda026ed208d4736938da05121a06f4e/roles/a3ad332ff078405ebc48aa8df0035cab => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 09:39:55.329548 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef5d07-1bfa-432c-bab5-aba25ebdfd9a None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:55.391172 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:55.401163 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aab04d-9ff1-4ea2-8c4d-5144c0ff83c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:55.402336 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aab04d-9ff1-4ea2-8c4d-5144c0ff83c5 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:55.402787 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aab04d-9ff1-4ea2-8c4d-5144c0ff83c5 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:55.403301 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aab04d-9ff1-4ea2-8c4d-5144c0ff83c5 None admin] PATH_INFO: `/v3/projects` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:55.405469 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aab04d-9ff1-4ea2-8c4d-5144c0ff83c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:55.406532 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aab04d-9ff1-4ea2-8c4d-5144c0ff83c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:55.409725 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aab04d-9ff1-4ea2-8c4d-5144c0ff83c5 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:55.434692 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 290/582] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 27 09:39:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:55.445017 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3429153-6f5d-4997-903b-0befb3faad85 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:55.666155 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3429153-6f5d-4997-903b-0befb3faad85 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:55.718429 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:55.729726 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8fb88-c51b-4912-abb0-657e7ad0a5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:55.730628 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8fb88-c51b-4912-abb0-657e7ad0a5c6 None admin] REQUEST_METHOD: `PUT` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:55.731140 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8fb88-c51b-4912-abb0-657e7ad0a5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:55.731423 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8fb88-c51b-4912-abb0-657e7ad0a5c6 None admin] PATH_INFO: `/v3/projects/dbe5c492b05e40448942bb2500c185ee/users/1575d436c7d043d886293e24fa5f64fb/roles/a3ad332ff078405ebc48aa8df0035cab` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:55.748867 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8fb88-c51b-4912-abb0-657e7ad0a5c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbe5c492b05e40448942bb2500c185ee, user_id=1575d436c7d043d886293e24fa5f64fb, role_id=a3ad332ff078405ebc48aa8df0035cab)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:55.750339 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8fb88-c51b-4912-abb0-657e7ad0a5c6 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:55.773909 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 293/583] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 27 09:39:55 2022] PUT /identity/v3/projects/dbe5c492b05e40448942bb2500c185ee/users/1575d436c7d043d886293e24fa5f64fb/roles/a3ad332ff078405ebc48aa8df0035cab => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 09:39:57.960406 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bffc88-0a7d-4b74-844c-855a1a44165b None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:57.960941 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bffc88-0a7d-4b74-844c-855a1a44165b None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:57.960941 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bffc88-0a7d-4b74-844c-855a1a44165b None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:57.962619 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 291/584] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:57.967580 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea47e4-fd86-484d-b2be-7dccb1b5d6de None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:57.968100 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea47e4-fd86-484d-b2be-7dccb1b5d6de None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:57.968100 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea47e4-fd86-484d-b2be-7dccb1b5d6de None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:57.969847 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 294/585] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:57.970483 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403d798-3435-4447-a9d7-0a5a860bf096 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:57.971066 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403d798-3435-4447-a9d7-0a5a860bf096 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:57.971525 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403d798-3435-4447-a9d7-0a5a860bf096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:57.975638 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c873e6-d296-4755-af6b-ca24ed7b3a1e None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:57.975943 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c873e6-d296-4755-af6b-ca24ed7b3a1e None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:57.976186 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c873e6-d296-4755-af6b-ca24ed7b3a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:57.994160 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-1403d798-3435-4447-a9d7-0a5a860bf096 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:57.996042 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-1403d798-3435-4447-a9d7-0a5a860bf096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:57.997331 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-58c873e6-d296-4755-af6b-ca24ed7b3a1e None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:57.998498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-58c873e6-d296-4755-af6b-ca24ed7b3a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:58.098912 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 292/586] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:39:58.114107 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 295/587] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 09:39:58.245651 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4cdbe-63f5-46ed-9926-3de5ba36ad07 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:58.245910 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4cdbe-63f5-46ed-9926-3de5ba36ad07 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:58.246059 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4cdbe-63f5-46ed-9926-3de5ba36ad07 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:58.247858 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 293/588] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:58.257432 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c87fc3-9467-48a1-b096-e92206bedf3e None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:58.258445 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c87fc3-9467-48a1-b096-e92206bedf3e None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:58.259263 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c87fc3-9467-48a1-b096-e92206bedf3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:58.285487 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-f5c87fc3-9467-48a1-b096-e92206bedf3e None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:58.287940 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-f5c87fc3-9467-48a1-b096-e92206bedf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:58.410496 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 296/589] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:39:58.430029 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4cdbe-63f5-46ed-9926-3de5ba36ad07 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:58.454594 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c87fc3-9467-48a1-b096-e92206bedf3e None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:58.508370 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:58.592263 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4cdbe-63f5-46ed-9926-3de5ba36ad07 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:58.599677 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c87fc3-9467-48a1-b096-e92206bedf3e None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:58.641275 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:58.666575 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ae3ae-0ee0-47a3-8b46-4c0e5b73095d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:58.668175 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ae3ae-0ee0-47a3-8b46-4c0e5b73095d None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:58.668754 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ae3ae-0ee0-47a3-8b46-4c0e5b73095d None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:58.668962 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e91a4-2569-47c7-8a92-dd5893b0c83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:58.669630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e91a4-2569-47c7-8a92-dd5893b0c83d None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:58.669803 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ae3ae-0ee0-47a3-8b46-4c0e5b73095d None admin] PATH_INFO: `/v3/roles/service` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:58.669978 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e91a4-2569-47c7-8a92-dd5893b0c83d None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:58.670345 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e91a4-2569-47c7-8a92-dd5893b0c83d None admin] PATH_INFO: `/v3/roles/service` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:58.690363 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e91a4-2569-47c7-8a92-dd5893b0c83d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:58.692858 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ae3ae-0ee0-47a3-8b46-4c0e5b73095d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:58.699304 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-176ae3ae-0ee0-47a3-8b46-4c0e5b73095d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:39:58.699304 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:58.699304 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:58.699304 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:58.699304 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:58.699304 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:58.699304 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:58.699304 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:58.699304 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:58.699304 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:58.699304 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:58.699304 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:58.699304 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:58.699304 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:58.699304 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:58.699304 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:58.701621 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:58.701621 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:58.701621 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:58.701621 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:58.701621 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:58.701621 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:58.701621 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:58.701621 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:58.701621 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:58.701621 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:58.701621 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:58.701621 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:58.701621 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:58.701621 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:58.701621 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:58.701621 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:58.703553 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:58.703553 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:58.703553 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:58.703553 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:58.703553 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:58.703553 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:58.703553 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:58.703553 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:58.703553 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:58.703553 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:58.703553 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:39:58.703553 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:58.703553 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 294/590] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 27 09:39:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:58.706220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-965e91a4-2569-47c7-8a92-dd5893b0c83d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:39:58.706220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:58.706220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:58.706220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:58.706220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:58.706220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:58.706220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:58.706220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:58.706220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:58.706220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:58.706220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:58.706220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:58.706220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:58.706220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:58.706220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:58.706220 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:58.708343 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:58.708343 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:58.708343 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:58.708343 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:58.708343 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:58.708343 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:58.708343 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:58.708343 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:58.708343 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:58.708343 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:58.708343 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:58.708343 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:58.708343 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:58.708343 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:58.708343 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:58.708343 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:58.710955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:58.710955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:58.710955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:58.710955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:58.710955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:58.710955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:58.710955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:58.710955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:58.710955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:58.710955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:58.710955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:39:58.710955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:58.712792 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ae3ae-0ee0-47a3-8b46-4c0e5b73095d None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:58.715668 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 297/591] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 27 09:39:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 09:39:58.726840 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e91a4-2569-47c7-8a92-dd5893b0c83d None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:58.832647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:58.837187 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e91a4-2569-47c7-8a92-dd5893b0c83d None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:58.881255 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a19591-0a68-42cd-b309-c7e39a3b1890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:58.881869 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a19591-0a68-42cd-b309-c7e39a3b1890 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:58.882141 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a19591-0a68-42cd-b309-c7e39a3b1890 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:58.882422 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a19591-0a68-42cd-b309-c7e39a3b1890 None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:58.883115 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a19591-0a68-42cd-b309-c7e39a3b1890 None admin] RBAC: Adding query filter params (name=service) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:58.883463 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a19591-0a68-42cd-b309-c7e39a3b1890 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:58.884811 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a19591-0a68-42cd-b309-c7e39a3b1890 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:58.894270 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 298/592] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 27 09:39:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:58.895968 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a19591-0a68-42cd-b309-c7e39a3b1890 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:58.909765 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ae3ae-0ee0-47a3-8b46-4c0e5b73095d None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:58.949763 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ea99b-5fd6-4009-b7e5-305c2c018ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:58.950380 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ea99b-5fd6-4009-b7e5-305c2c018ded None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:58.950660 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ea99b-5fd6-4009-b7e5-305c2c018ded None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:58.950957 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ea99b-5fd6-4009-b7e5-305c2c018ded None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:58.951639 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ea99b-5fd6-4009-b7e5-305c2c018ded None admin] RBAC: Adding query filter params (name=service) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:58.951938 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ea99b-5fd6-4009-b7e5-305c2c018ded None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:58.953360 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ea99b-5fd6-4009-b7e5-305c2c018ded None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:58.962546 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 295/593] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 27 09:39:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:39:58.963529 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ea99b-5fd6-4009-b7e5-305c2c018ded None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:59.019678 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a19591-0a68-42cd-b309-c7e39a3b1890 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:59.029517 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:59.058020 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330710c5-57e1-4d56-ac9a-03c62575fdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:59.058678 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330710c5-57e1-4d56-ac9a-03c62575fdb8 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:59.058980 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330710c5-57e1-4d56-ac9a-03c62575fdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:59.059246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330710c5-57e1-4d56-ac9a-03c62575fdb8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:59.070592 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330710c5-57e1-4d56-ac9a-03c62575fdb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:39:59.075924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-330710c5-57e1-4d56-ac9a-03c62575fdb8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:39:59.075924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:59.075924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:59.075924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:59.075924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:59.075924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:59.075924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:59.075924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:59.075924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:59.075924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:59.075924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:59.075924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:59.075924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:39:59.075924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:39:59.075924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:39:59.075924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:39:59.076987 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:39:59.076987 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:39:59.076987 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:39:59.076987 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:39:59.076987 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:59.076987 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:59.076987 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:59.076987 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:59.076987 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:59.076987 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:59.076987 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:59.076987 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:59.076987 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:59.076987 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:59.076987 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:59.076987 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:59.077800 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:59.077800 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:59.077800 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:59.077800 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:59.077800 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:39:59.077800 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:39:59.077800 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:39:59.077800 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:39:59.077800 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:39:59.077800 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:39:59.077800 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:39:59.077800 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:59.077800 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 299/594] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 27 09:39:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:59.078496 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e67499-f6d2-4e6c-8757-31926dbdd7cc None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:59.078582 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e67499-f6d2-4e6c-8757-31926dbdd7cc None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:59.079067 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e67499-f6d2-4e6c-8757-31926dbdd7cc None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:59.080224 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 300/595] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:39:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:39:59.080800 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e67499-f6d2-4e6c-8757-31926dbdd7cc None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:59.107455 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:59.108924 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ea99b-5fd6-4009-b7e5-305c2c018ded None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:59.145054 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d35bd-27bb-4822-8384-52d6e1fb493f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:59.145969 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d35bd-27bb-4822-8384-52d6e1fb493f None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:59.146314 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d35bd-27bb-4822-8384-52d6e1fb493f None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:59.146738 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d35bd-27bb-4822-8384-52d6e1fb493f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:59.158873 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d35bd-27bb-4822-8384-52d6e1fb493f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:59.160382 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d35bd-27bb-4822-8384-52d6e1fb493f None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:59.176086 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-be4d35bd-27bb-4822-8384-52d6e1fb493f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:59.176086 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:59.176086 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:59.176086 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:59.176086 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:59.176086 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:59.176086 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:59.176086 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:59.176086 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:59.176086 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:59.176086 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:59.176086 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:59.176086 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:39:59.176086 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:39:59.176086 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:39:59.176086 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:39:59.177625 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:59.177625 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:59.177625 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:59.177625 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:59.177625 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:59.177625 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:59.177625 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:59.177625 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:59.177625 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:59.177625 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:59.177625 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:59.177625 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:59.177625 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:59.177625 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:59.177625 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:59.177625 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:59.177625 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:39:59.178676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:39:59.178676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:59.178676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:59.178676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 296/596] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:39:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:59.178676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d35bd-27bb-4822-8384-52d6e1fb493f None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:59.199442 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e67499-f6d2-4e6c-8757-31926dbdd7cc None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:59.251355 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93724934-ee9b-4a7d-a3b7-a3f13ff53d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:59.252434 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93724934-ee9b-4a7d-a3b7-a3f13ff53d85 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:59.252805 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93724934-ee9b-4a7d-a3b7-a3f13ff53d85 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:59.253290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93724934-ee9b-4a7d-a3b7-a3f13ff53d85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:59.271743 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93724934-ee9b-4a7d-a3b7-a3f13ff53d85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:59.274314 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93724934-ee9b-4a7d-a3b7-a3f13ff53d85 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:59.284489 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:59.292538 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d35bd-27bb-4822-8384-52d6e1fb493f None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:59.300689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-93724934-ee9b-4a7d-a3b7-a3f13ff53d85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:59.300689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:59.300689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:59.300689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:59.300689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:59.300689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:59.300689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:59.300689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:59.300689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:59.300689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:59.300689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:59.300689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:59.300689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:39:59.300689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:39:59.300689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:39:59.300689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:39:59.301787 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:59.301787 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:59.301787 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:59.301787 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:59.301787 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:59.301787 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:59.301787 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:59.301787 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:59.301787 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:59.301787 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:59.301787 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:59.301787 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:59.301787 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:59.301787 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:59.301787 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:59.301787 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:59.301787 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:39:59.302742 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:39:59.302742 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:59.302742 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:59.302742 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 301/597] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:59.303968 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310272c-58c7-4002-849b-27ffa971e83b None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:59.304599 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310272c-58c7-4002-849b-27ffa971e83b None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:59.304599 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310272c-58c7-4002-849b-27ffa971e83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:59.326878 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-4310272c-58c7-4002-849b-27ffa971e83b None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:39:59.327501 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-4310272c-58c7-4002-849b-27ffa971e83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:39:59.338879 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859da4ec-2817-469d-81cb-6a96e4a0493b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:59.339919 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859da4ec-2817-469d-81cb-6a96e4a0493b None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:59.340412 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859da4ec-2817-469d-81cb-6a96e4a0493b None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:59.340891 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859da4ec-2817-469d-81cb-6a96e4a0493b None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:59.342083 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859da4ec-2817-469d-81cb-6a96e4a0493b None admin] RBAC: Adding query filter params (name=service) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:59.342628 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859da4ec-2817-469d-81cb-6a96e4a0493b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:59.345230 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859da4ec-2817-469d-81cb-6a96e4a0493b None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:59.359690 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 297/598] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 27 09:39:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:59.361094 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859da4ec-2817-469d-81cb-6a96e4a0493b None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:59.406582 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 302/599] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:39:59.408520 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310272c-58c7-4002-849b-27ffa971e83b None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:59.412622 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:59.503347 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859da4ec-2817-469d-81cb-6a96e4a0493b None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:59.531920 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310272c-58c7-4002-849b-27ffa971e83b None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:59.563827 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6073a-604f-469e-88db-6a1e6be6c26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:59.564459 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6073a-604f-469e-88db-6a1e6be6c26c None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:59.564726 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6073a-604f-469e-88db-6a1e6be6c26c None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:59.565144 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6073a-604f-469e-88db-6a1e6be6c26c None admin] PATH_INFO: `/v3/domains` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:59.565808 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6073a-604f-469e-88db-6a1e6be6c26c None admin] RBAC: Adding query filter params (name=Default) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:59.566111 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6073a-604f-469e-88db-6a1e6be6c26c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:59.567613 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6073a-604f-469e-88db-6a1e6be6c26c None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:59.589115 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b285c-4623-44d3-943c-eda33846b031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:59.590616 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b285c-4623-44d3-943c-eda33846b031 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:59.591071 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b285c-4623-44d3-943c-eda33846b031 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:59.596288 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 298/600] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:59.596492 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b285c-4623-44d3-943c-eda33846b031 None admin] PATH_INFO: `/v3/domains` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:59.596492 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b285c-4623-44d3-943c-eda33846b031 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:39:59.596492 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b285c-4623-44d3-943c-eda33846b031 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:59.596706 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6073a-604f-469e-88db-6a1e6be6c26c None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:59.596924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b285c-4623-44d3-943c-eda33846b031 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:59.613555 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 303/601] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:39:59.614324 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b285c-4623-44d3-943c-eda33846b031 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:59.634963 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:59.692321 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:59.751671 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b285c-4623-44d3-943c-eda33846b031 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:59.756087 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6073a-604f-469e-88db-6a1e6be6c26c None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:59.792021 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b546258-6b40-45d5-b61f-24fed42d2802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:59.792668 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b546258-6b40-45d5-b61f-24fed42d2802 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:59.792934 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b546258-6b40-45d5-b61f-24fed42d2802 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:59.793292 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b546258-6b40-45d5-b61f-24fed42d2802 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:59.801340 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b546258-6b40-45d5-b61f-24fed42d2802 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:59.803040 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b546258-6b40-45d5-b61f-24fed42d2802 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:59.803654 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45423cf-0499-4e19-9ac5-fcd5457ed8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:59.804808 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45423cf-0499-4e19-9ac5-fcd5457ed8f6 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:59.805250 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45423cf-0499-4e19-9ac5-fcd5457ed8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:59.805740 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45423cf-0499-4e19-9ac5-fcd5457ed8f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:39:59.814956 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-0b546258-6b40-45d5-b61f-24fed42d2802 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 27 09:39:59.814956 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:59.814956 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:59.814956 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:59.814956 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:59.814956 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:59.814956 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:59.814956 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:59.814956 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:59.814956 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:59.814956 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:59.814956 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:59.814956 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 09:39:59.814956 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 09:39:59.814956 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 09:39:59.814956 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 09:39:59.816825 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:59.816825 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:59.816825 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 09:39:59.816825 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:39:59.816825 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 09:39:59.816825 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:39:59.816825 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:59.816825 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:59.816825 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:59.816825 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:59.816825 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:59.816825 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:59.816825 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:59.816825 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:59.816825 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:59.816825 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:59.816825 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:59.816825 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:59.819285 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:59.819285 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:59.819285 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 09:39:59.819285 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 09:39:59.819285 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 09:39:59.819285 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 09:39:59.819285 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 09:39:59.819285 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 09:39:59.819285 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 27 09:39:59.819285 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:39:59.819285 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 304/602] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 27 09:39:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:59.819285 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b546258-6b40-45d5-b61f-24fed42d2802 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:59.827347 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45423cf-0499-4e19-9ac5-fcd5457ed8f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:39:59.828948 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45423cf-0499-4e19-9ac5-fcd5457ed8f6 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:39:59.845868 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-b45423cf-0499-4e19-9ac5-fcd5457ed8f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:59.845868 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:39:59.845868 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:39:59.845868 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:39:59.845868 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:39:59.845868 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:39:59.845868 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:39:59.845868 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:39:59.845868 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:39:59.845868 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:39:59.845868 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:39:59.845868 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:39:59.845868 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:39:59.845868 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:39:59.845868 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:39:59.845868 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:39:59.847557 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:39:59.847557 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:39:59.847557 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:39:59.847557 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:39:59.847557 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:39:59.847557 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:39:59.847557 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:39:59.847557 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:39:59.847557 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:39:59.847557 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:39:59.847557 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:39:59.847557 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:39:59.847557 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:39:59.847557 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:39:59.847557 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:39:59.847557 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:39:59.847557 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:39:59.849774 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:39:59.849774 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:39:59.849774 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:39:59.849774 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 299/603] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:39:59.849774 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45423cf-0499-4e19-9ac5-fcd5457ed8f6 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:39:59.930594 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:59.941441 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b546258-6b40-45d5-b61f-24fed42d2802 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:59.970833 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45423cf-0499-4e19-9ac5-fcd5457ed8f6 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:39:59.972784 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:39:59.986205 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942b037-eca5-45a3-9b0e-16bf5bf84fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:39:59.987050 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942b037-eca5-45a3-9b0e-16bf5bf84fa5 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:39:59.987406 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942b037-eca5-45a3-9b0e-16bf5bf84fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:39:59.987752 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942b037-eca5-45a3-9b0e-16bf5bf84fa5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:00.001542 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942b037-eca5-45a3-9b0e-16bf5bf84fa5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:00.003816 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942b037-eca5-45a3-9b0e-16bf5bf84fa5 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:00.018468 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-d942b037-eca5-45a3-9b0e-16bf5bf84fa5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 09:40:00.018468 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:00.018468 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:00.018468 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:00.018468 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:00.018468 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:00.018468 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:00.018468 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:00.018468 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:00.018468 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:00.018468 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:00.018468 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:00.018468 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 09:40:00.018468 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 09:40:00.018468 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 09:40:00.018468 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 09:40:00.020557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:00.020557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:00.020557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 09:40:00.020557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:40:00.020557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 09:40:00.020557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:40:00.020557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:00.020557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:00.020557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:00.020557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:00.020557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:00.020557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:00.020557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:00.020557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:00.020557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:00.020557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:00.020557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:00.020557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:00.021672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:00.021672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:00.021672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 09:40:00.021672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 09:40:00.021672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 09:40:00.021672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 09:40:00.021672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 09:40:00.021672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 09:40:00.021672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 09:40:00.021672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:00.022375 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09452592-eaf9-4478-9d94-7429102fa99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:00.022539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 305/604] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:39:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:00.022539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942b037-eca5-45a3-9b0e-16bf5bf84fa5 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:00.022832 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09452592-eaf9-4478-9d94-7429102fa99b None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:00.022832 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09452592-eaf9-4478-9d94-7429102fa99b None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:00.022832 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09452592-eaf9-4478-9d94-7429102fa99b None admin] PATH_INFO: `/v3/roles/service` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:00.042788 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09452592-eaf9-4478-9d94-7429102fa99b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:40:00.049561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-09452592-eaf9-4478-9d94-7429102fa99b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:40:00.049561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:00.049561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:00.049561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:00.049561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:00.049561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:00.049561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:00.049561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:00.049561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:00.049561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:00.049561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:00.049561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:00.049561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:40:00.049561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:40:00.049561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:40:00.049561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:40:00.050637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:40:00.050637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:40:00.050637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:40:00.050637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:40:00.050637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:00.050637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:00.050637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:00.050637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:00.050637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:00.050637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:00.050637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:00.050637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:00.050637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:00.050637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:00.050637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:00.050637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:00.051495 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:00.051495 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:00.051495 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:00.051495 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:00.051495 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:40:00.051495 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:40:00.051495 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:40:00.051495 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:40:00.051495 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:40:00.051495 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:40:00.051495 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:40:00.051495 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:00.051495 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 300/605] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 27 09:39:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:00.052358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09452592-eaf9-4478-9d94-7429102fa99b None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:00.150632 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942b037-eca5-45a3-9b0e-16bf5bf84fa5 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:00.168870 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09452592-eaf9-4478-9d94-7429102fa99b None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:00.202533 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:00.205394 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7369814-9c78-4836-a254-7a49835151bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:00.206054 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7369814-9c78-4836-a254-7a49835151bc None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:00.206355 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7369814-9c78-4836-a254-7a49835151bc None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:00.206664 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7369814-9c78-4836-a254-7a49835151bc None admin] PATH_INFO: `/v3/users` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:00.207827 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7369814-9c78-4836-a254-7a49835151bc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:00.208151 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7369814-9c78-4836-a254-7a49835151bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:00.209799 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7369814-9c78-4836-a254-7a49835151bc None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:00.210814 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae9eb5-d78d-4e8e-a208-06af7f9c7712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:00.211424 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae9eb5-d78d-4e8e-a208-06af7f9c7712 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:00.211694 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae9eb5-d78d-4e8e-a208-06af7f9c7712 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:00.211964 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae9eb5-d78d-4e8e-a208-06af7f9c7712 None admin] PATH_INFO: `/v3/domains` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:00.212621 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae9eb5-d78d-4e8e-a208-06af7f9c7712 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:00.212897 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae9eb5-d78d-4e8e-a208-06af7f9c7712 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:00.214302 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae9eb5-d78d-4e8e-a208-06af7f9c7712 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:00.227284 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 301/606] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:00.228159 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae9eb5-d78d-4e8e-a208-06af7f9c7712 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:00.231973 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 306/607] 10.222.0.49 () {56 vars in 1139 bytes} [Tue Sep 27 09:40:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:00.232140 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7369814-9c78-4836-a254-7a49835151bc None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:00.293257 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:00.349219 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae9eb5-d78d-4e8e-a208-06af7f9c7712 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:00.367392 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7369814-9c78-4836-a254-7a49835151bc None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:00.398024 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fc8aa-0338-4bc7-8771-ce29c451f6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:00.399000 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fc8aa-0338-4bc7-8771-ce29c451f6fe None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:00.399397 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fc8aa-0338-4bc7-8771-ce29c451f6fe None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:00.399819 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fc8aa-0338-4bc7-8771-ce29c451f6fe None admin] PATH_INFO: `/v3/users` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:00.401228 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fc8aa-0338-4bc7-8771-ce29c451f6fe None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:00.401778 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fc8aa-0338-4bc7-8771-ce29c451f6fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:00.404616 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fc8aa-0338-4bc7-8771-ce29c451f6fe None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:00.422089 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627266f9-d88f-450e-af3e-9734f9a1251f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:00.422719 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627266f9-d88f-450e-af3e-9734f9a1251f None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:00.423033 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627266f9-d88f-450e-af3e-9734f9a1251f None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:00.423298 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627266f9-d88f-450e-af3e-9734f9a1251f None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:00.423972 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627266f9-d88f-450e-af3e-9734f9a1251f None admin] RBAC: Adding query filter params (name=service) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:00.424266 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627266f9-d88f-450e-af3e-9734f9a1251f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:00.425698 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627266f9-d88f-450e-af3e-9734f9a1251f None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:00.441455 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 307/608] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 27 09:40:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:00.441455 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627266f9-d88f-450e-af3e-9734f9a1251f None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:00.441869 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 302/609] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Sep 27 09:40:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:00.441869 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fc8aa-0338-4bc7-8771-ce29c451f6fe None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:00.500919 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:00.559844 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627266f9-d88f-450e-af3e-9734f9a1251f None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:00.561657 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fc8aa-0338-4bc7-8771-ce29c451f6fe None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:00.561888 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:00.607892 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fd6f5-5c9b-44a8-8940-ffd18f1af296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:00.608613 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fd6f5-5c9b-44a8-8940-ffd18f1af296 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:00.608943 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fd6f5-5c9b-44a8-8940-ffd18f1af296 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:00.609040 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cfd2d-7f00-4150-aa44-0ce0c7311e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:00.609306 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fd6f5-5c9b-44a8-8940-ffd18f1af296 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:00.609973 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cfd2d-7f00-4150-aa44-0ce0c7311e22 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:00.610428 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cfd2d-7f00-4150-aa44-0ce0c7311e22 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:00.610917 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cfd2d-7f00-4150-aa44-0ce0c7311e22 None admin] PATH_INFO: `/v3/users/nova` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:00.625325 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cfd2d-7f00-4150-aa44-0ce0c7311e22 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:00.626867 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cfd2d-7f00-4150-aa44-0ce0c7311e22 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:00.640187 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-029cfd2d-7f00-4150-aa44-0ce0c7311e22 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 09:40:00.640187 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:00.640187 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:00.640187 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:00.640187 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:00.640187 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:00.640187 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:00.640187 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:00.640187 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:00.640187 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:00.640187 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:00.640187 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:00.640187 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 09:40:00.640187 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 09:40:00.640187 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 09:40:00.640187 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 09:40:00.642308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:00.642308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:00.642308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 09:40:00.642308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:40:00.642308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 09:40:00.642308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:40:00.642308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:00.642308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:00.642308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:00.642308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:00.642308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:00.642308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:00.642308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:00.642308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:00.642308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:00.642308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:00.642308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:00.642308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:00.644148 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:00.644148 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:00.644148 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 09:40:00.644148 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 09:40:00.644148 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 09:40:00.644148 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 09:40:00.644148 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 09:40:00.644148 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 09:40:00.644148 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 09:40:00.644148 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:00.644148 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 308/610] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Sep 27 09:40:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:00.644148 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cfd2d-7f00-4150-aa44-0ce0c7311e22 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:00.709588 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3fd6f5-5c9b-44a8-8940-ffd18f1af296 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:00.711129 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3fd6f5-5c9b-44a8-8940-ffd18f1af296 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:00.780017 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cfd2d-7f00-4150-aa44-0ce0c7311e22 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:00.787946 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:00.820792 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69576a-22e0-4c1b-a423-6e1759324778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:00.821569 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69576a-22e0-4c1b-a423-6e1759324778 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:00.821902 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69576a-22e0-4c1b-a423-6e1759324778 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:00.822174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69576a-22e0-4c1b-a423-6e1759324778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:00.835351 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69576a-22e0-4c1b-a423-6e1759324778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:00.836871 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69576a-22e0-4c1b-a423-6e1759324778 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:00.852807 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-4a69576a-22e0-4c1b-a423-6e1759324778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:40:00.852807 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:00.852807 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:00.852807 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:00.852807 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:00.852807 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:00.852807 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:00.852807 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:00.852807 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:00.852807 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:00.852807 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:00.852807 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:00.852807 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:40:00.852807 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:40:00.852807 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:40:00.852807 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:40:00.859874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:00.859874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:00.859874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:00.859874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:00.859874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:00.859874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:00.859874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:00.859874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:00.859874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:00.859874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:00.859874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:00.859874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:00.859874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:00.859874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:00.859874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:00.859874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:00.859874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:40:00.861592 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:40:00.861592 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:40:00.861592 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:00.861592 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 309/611] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:00.861592 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69576a-22e0-4c1b-a423-6e1759324778 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:00.872845 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:00.873337 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 303/612] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:40:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:40:00.874380 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fd6f5-5c9b-44a8-8940-ffd18f1af296 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:00.984332 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69576a-22e0-4c1b-a423-6e1759324778 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:00.994974 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fd6f5-5c9b-44a8-8940-ffd18f1af296 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:01.033090 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b192815-6008-4334-9d14-6e8dde379f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:01.033627 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b192815-6008-4334-9d14-6e8dde379f8a None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:01.033898 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b192815-6008-4334-9d14-6e8dde379f8a None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:01.034164 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b192815-6008-4334-9d14-6e8dde379f8a None admin] PATH_INFO: `/v3/users` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:01.034931 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b192815-6008-4334-9d14-6e8dde379f8a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:01.035236 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b192815-6008-4334-9d14-6e8dde379f8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:01.037058 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b192815-6008-4334-9d14-6e8dde379f8a None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:01.040712 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5eef0-0475-45a6-89f3-f0b4a9762343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:01.041759 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5eef0-0475-45a6-89f3-f0b4a9762343 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:01.042246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5eef0-0475-45a6-89f3-f0b4a9762343 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:01.042728 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5eef0-0475-45a6-89f3-f0b4a9762343 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:01.057303 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 304/613] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Sep 27 09:40:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:01.058431 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b192815-6008-4334-9d14-6e8dde379f8a None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:01.067993 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:01.148224 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5eef0-0475-45a6-89f3-f0b4a9762343 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:01.149745 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5eef0-0475-45a6-89f3-f0b4a9762343 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:01.167252 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:01.184275 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b192815-6008-4334-9d14-6e8dde379f8a None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:01.228930 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18376d24-cb6d-45a7-9878-edae7d826b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:01.229568 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18376d24-cb6d-45a7-9878-edae7d826b0f None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:01.229834 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18376d24-cb6d-45a7-9878-edae7d826b0f None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:01.230112 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18376d24-cb6d-45a7-9878-edae7d826b0f None admin] PATH_INFO: `/v3/domains` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:01.230753 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18376d24-cb6d-45a7-9878-edae7d826b0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:01.231110 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18376d24-cb6d-45a7-9878-edae7d826b0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:01.232538 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18376d24-cb6d-45a7-9878-edae7d826b0f None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:01.246716 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 305/614] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:01.247889 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18376d24-cb6d-45a7-9878-edae7d826b0f None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:01.293589 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 310/615] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:40:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:40:01.295405 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5eef0-0475-45a6-89f3-f0b4a9762343 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:01.329084 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:01.373376 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18376d24-cb6d-45a7-9878-edae7d826b0f None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:01.411026 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5eef0-0475-45a6-89f3-f0b4a9762343 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:01.413675 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489f9a1-7da5-405d-b563-d750da1ab95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:01.414660 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489f9a1-7da5-405d-b563-d750da1ab95d None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:01.414660 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489f9a1-7da5-405d-b563-d750da1ab95d None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:01.415008 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489f9a1-7da5-405d-b563-d750da1ab95d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:01.427826 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489f9a1-7da5-405d-b563-d750da1ab95d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:01.429343 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489f9a1-7da5-405d-b563-d750da1ab95d None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:01.429603 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:01.445358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-f489f9a1-7da5-405d-b563-d750da1ab95d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:40:01.445358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:01.445358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:01.445358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:01.445358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:01.445358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:01.445358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:01.445358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:01.445358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:01.445358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:01.445358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:01.445358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:01.445358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:40:01.445358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:40:01.445358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:40:01.445358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:40:01.455134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:01.455134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:01.455134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:01.455134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:01.455134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:01.455134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:01.455134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:01.455134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:01.455134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:01.455134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:01.455134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:01.455134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:01.455134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:01.455134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:01.455134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:01.455134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:01.455134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:40:01.456868 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:40:01.456868 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:40:01.456868 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:01.456868 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 306/616] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:01.456868 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489f9a1-7da5-405d-b563-d750da1ab95d None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:01.457393 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e8598-b3ef-4c7e-8e44-bcba8c9d2938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:01.457612 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e8598-b3ef-4c7e-8e44-bcba8c9d2938 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:01.458091 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e8598-b3ef-4c7e-8e44-bcba8c9d2938 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:01.458709 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e8598-b3ef-4c7e-8e44-bcba8c9d2938 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:01.532555 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e8598-b3ef-4c7e-8e44-bcba8c9d2938 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:01.534238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e8598-b3ef-4c7e-8e44-bcba8c9d2938 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:01.587955 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489f9a1-7da5-405d-b563-d750da1ab95d None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:01.608626 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:01.630703 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699c17a-bdc8-4244-90bd-abde313b93ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:01.631766 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699c17a-bdc8-4244-90bd-abde313b93ff None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:01.632080 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699c17a-bdc8-4244-90bd-abde313b93ff None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:01.632418 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699c17a-bdc8-4244-90bd-abde313b93ff None admin] PATH_INFO: `/v3/users/glance` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:01.641820 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699c17a-bdc8-4244-90bd-abde313b93ff None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:01.643360 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699c17a-bdc8-4244-90bd-abde313b93ff None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:01.657853 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-5699c17a-bdc8-4244-90bd-abde313b93ff None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 27 09:40:01.657853 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:01.657853 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:01.657853 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:01.657853 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:01.657853 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:01.657853 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:01.657853 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:01.657853 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:01.657853 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:01.657853 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:01.657853 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:01.657853 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 09:40:01.657853 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 09:40:01.657853 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 09:40:01.657853 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 09:40:01.659318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:01.659318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:01.659318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 09:40:01.659318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:40:01.659318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 09:40:01.659318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:40:01.659318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:01.659318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:01.659318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:01.659318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:01.659318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:01.659318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:01.659318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:01.659318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:01.659318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:01.659318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:01.659318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:01.659318 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:01.661148 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:01.661148 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:01.661148 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 09:40:01.661148 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 09:40:01.661148 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 09:40:01.661148 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 09:40:01.661148 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 09:40:01.661148 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 09:40:01.661148 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 27 09:40:01.661148 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:01.661148 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 307/617] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:40:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:01.661148 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699c17a-bdc8-4244-90bd-abde313b93ff None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:01.664337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 311/618] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:40:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:40:01.664337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e8598-b3ef-4c7e-8e44-bcba8c9d2938 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:01.686869 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:01.789528 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699c17a-bdc8-4244-90bd-abde313b93ff None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:01.796807 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e8598-b3ef-4c7e-8e44-bcba8c9d2938 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:01.833070 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f6cfb-e640-4fec-9188-90a708a79459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:01.834274 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f6cfb-e640-4fec-9188-90a708a79459 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:01.834720 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f6cfb-e640-4fec-9188-90a708a79459 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:01.835320 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f6cfb-e640-4fec-9188-90a708a79459 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:01.840779 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb6575-8fb7-47b7-882c-222e2537858e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:01.841397 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb6575-8fb7-47b7-882c-222e2537858e None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:01.841665 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb6575-8fb7-47b7-882c-222e2537858e None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:01.841943 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb6575-8fb7-47b7-882c-222e2537858e None admin] PATH_INFO: `/v3/domains` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:01.842592 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb6575-8fb7-47b7-882c-222e2537858e None admin] RBAC: Adding query filter params (name=Default) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:01.842930 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb6575-8fb7-47b7-882c-222e2537858e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:01.844307 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb6575-8fb7-47b7-882c-222e2537858e None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:01.853775 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f6cfb-e640-4fec-9188-90a708a79459 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:01.856480 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f6cfb-e640-4fec-9188-90a708a79459 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:01.856726 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 312/619] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:01.857581 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb6575-8fb7-47b7-882c-222e2537858e None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:01.879190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-9f6f6cfb-e640-4fec-9188-90a708a79459 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:40:01.879190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:01.879190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:01.879190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:01.879190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:01.879190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:01.879190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:01.879190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:01.879190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:01.879190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:01.879190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:01.879190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:01.879190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:40:01.879190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:40:01.879190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:40:01.879190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:40:01.881314 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:01.881314 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:01.881314 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:01.881314 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:01.881314 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:01.881314 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:01.881314 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:01.881314 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:01.881314 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:01.881314 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:01.881314 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:01.881314 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:01.881314 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:01.881314 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:01.881314 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:01.881314 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:01.881314 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:40:01.882604 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:40:01.882604 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:40:01.882604 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:01.882604 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 308/620] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:01.882604 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f6cfb-e640-4fec-9188-90a708a79459 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:01.932891 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:01.975523 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:02.018051 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb6575-8fb7-47b7-882c-222e2537858e None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:02.029700 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f6cfb-e640-4fec-9188-90a708a79459 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:02.067973 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd21557-4cfa-4327-b3ae-bb20ef6a2023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:02.069022 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd21557-4cfa-4327-b3ae-bb20ef6a2023 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:02.069414 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd21557-4cfa-4327-b3ae-bb20ef6a2023 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:02.069907 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd21557-4cfa-4327-b3ae-bb20ef6a2023 None admin] PATH_INFO: `/v3/users` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:02.070882 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd21557-4cfa-4327-b3ae-bb20ef6a2023 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:02.071337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd21557-4cfa-4327-b3ae-bb20ef6a2023 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:02.073115 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd21557-4cfa-4327-b3ae-bb20ef6a2023 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:02.089620 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641ddca-cba7-482f-bfd7-f5f5f00b3b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:02.090189 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641ddca-cba7-482f-bfd7-f5f5f00b3b71 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:02.090468 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641ddca-cba7-482f-bfd7-f5f5f00b3b71 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:02.090739 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641ddca-cba7-482f-bfd7-f5f5f00b3b71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:02.095818 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 313/621] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Sep 27 09:40:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:02.096909 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd21557-4cfa-4327-b3ae-bb20ef6a2023 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:02.108492 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641ddca-cba7-482f-bfd7-f5f5f00b3b71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:02.110010 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641ddca-cba7-482f-bfd7-f5f5f00b3b71 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:02.127140 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-5641ddca-cba7-482f-bfd7-f5f5f00b3b71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:40:02.127140 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:02.127140 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:02.127140 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:02.127140 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:02.127140 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:02.127140 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:02.127140 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:02.127140 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:02.127140 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:02.127140 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:02.127140 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:02.127140 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:40:02.127140 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:40:02.127140 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:40:02.127140 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:40:02.129106 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:02.129106 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:02.129106 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:02.129106 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:02.129106 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:02.129106 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:02.129106 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:02.129106 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:02.129106 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:02.129106 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:02.129106 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:02.129106 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:02.129106 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:02.129106 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:02.129106 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:02.129106 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:02.129106 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:40:02.132301 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:40:02.132301 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:40:02.132301 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:02.132301 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 309/622] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:02.132301 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641ddca-cba7-482f-bfd7-f5f5f00b3b71 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:02.232507 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:02.255122 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641ddca-cba7-482f-bfd7-f5f5f00b3b71 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:02.268730 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd21557-4cfa-4327-b3ae-bb20ef6a2023 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:02.297226 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639535a-17ce-4b60-aebc-35cc912a3a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:02.297980 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639535a-17ce-4b60-aebc-35cc912a3a9f None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:02.298378 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639535a-17ce-4b60-aebc-35cc912a3a9f None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:02.298755 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639535a-17ce-4b60-aebc-35cc912a3a9f None admin] PATH_INFO: `/v3/domains` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:02.299542 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639535a-17ce-4b60-aebc-35cc912a3a9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:02.299933 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639535a-17ce-4b60-aebc-35cc912a3a9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:02.301496 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639535a-17ce-4b60-aebc-35cc912a3a9f None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:02.313645 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:02.315309 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 310/623] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:02.316236 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639535a-17ce-4b60-aebc-35cc912a3a9f None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:02.321443 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307eba50-f25e-4875-8239-051e19d1648f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:02.322504 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eba50-f25e-4875-8239-051e19d1648f None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:02.323018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eba50-f25e-4875-8239-051e19d1648f None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:02.323476 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eba50-f25e-4875-8239-051e19d1648f None admin] PATH_INFO: `/v3/projects/service` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:02.332964 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307eba50-f25e-4875-8239-051e19d1648f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:02.335476 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307eba50-f25e-4875-8239-051e19d1648f None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:02.352292 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-307eba50-f25e-4875-8239-051e19d1648f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:40:02.352292 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:02.352292 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:02.352292 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:02.352292 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:02.352292 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:02.352292 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:02.352292 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:02.352292 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:02.352292 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:02.352292 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:02.352292 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:02.352292 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 09:40:02.352292 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 09:40:02.352292 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 09:40:02.354229 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 09:40:02.354229 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:02.354229 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:02.354229 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:02.354229 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:02.354229 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:02.354229 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:02.354229 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:02.354229 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:02.354229 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:02.354229 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:02.354229 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:02.354229 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:02.354229 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:02.354229 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:02.354229 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:02.354229 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:02.356189 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 09:40:02.356189 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 09:40:02.356189 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 09:40:02.356189 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 09:40:02.356189 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 09:40:02.356189 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 09:40:02.356189 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:40:02.356189 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:02.356189 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 314/624] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:40:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:02.357117 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307eba50-f25e-4875-8239-051e19d1648f None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:02.455628 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639535a-17ce-4b60-aebc-35cc912a3a9f None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:02.517083 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747e93f-3ac3-4b51-9170-cfcb23c644ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:02.518067 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747e93f-3ac3-4b51-9170-cfcb23c644ca None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:02.518528 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747e93f-3ac3-4b51-9170-cfcb23c644ca None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:02.519018 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747e93f-3ac3-4b51-9170-cfcb23c644ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:02.520460 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307eba50-f25e-4875-8239-051e19d1648f None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:02.541638 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:02.574602 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08594250-201d-48fd-b34c-7ab134dd61e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:02.575584 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08594250-201d-48fd-b34c-7ab134dd61e6 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:02.575958 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08594250-201d-48fd-b34c-7ab134dd61e6 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:02.576323 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08594250-201d-48fd-b34c-7ab134dd61e6 None admin] PATH_INFO: `/v3/domains` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:02.577215 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08594250-201d-48fd-b34c-7ab134dd61e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:02.577610 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08594250-201d-48fd-b34c-7ab134dd61e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:02.579526 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08594250-201d-48fd-b34c-7ab134dd61e6 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:02.596947 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 315/625] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:02.598374 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08594250-201d-48fd-b34c-7ab134dd61e6 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:02.628245 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5747e93f-3ac3-4b51-9170-cfcb23c644ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:02.630575 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5747e93f-3ac3-4b51-9170-cfcb23c644ca None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:02.683374 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:02.742324 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08594250-201d-48fd-b34c-7ab134dd61e6 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:02.800679 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 311/626] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:40:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 09:40:02.802211 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747e93f-3ac3-4b51-9170-cfcb23c644ca None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:02.802462 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81549cc-9bc3-4104-b48e-ccb6b442a9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:02.803359 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81549cc-9bc3-4104-b48e-ccb6b442a9eb None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:02.803771 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81549cc-9bc3-4104-b48e-ccb6b442a9eb None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:02.804169 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81549cc-9bc3-4104-b48e-ccb6b442a9eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:02.814466 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81549cc-9bc3-4104-b48e-ccb6b442a9eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:02.817146 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81549cc-9bc3-4104-b48e-ccb6b442a9eb None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:02.832689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-d81549cc-9bc3-4104-b48e-ccb6b442a9eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:40:02.832689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:02.832689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:02.832689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:02.832689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:02.832689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:02.832689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:02.832689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:02.832689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:02.832689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:02.832689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:02.832689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:02.832689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 09:40:02.832689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 09:40:02.832689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 09:40:02.834535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 09:40:02.834535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:02.834535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:02.834535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:02.834535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:02.834535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:02.834535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:02.834535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:02.834535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:02.834535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:02.834535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:02.834535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:02.834535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:02.834535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:02.834535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:02.834535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:02.834535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:02.837388 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 09:40:02.837388 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 09:40:02.837388 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 09:40:02.837388 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 09:40:02.837388 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 09:40:02.837388 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 09:40:02.837388 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:40:02.837388 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:02.837388 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 316/627] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:40:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:02.837388 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81549cc-9bc3-4104-b48e-ccb6b442a9eb None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:02.867426 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:02.957231 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747e93f-3ac3-4b51-9170-cfcb23c644ca None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:02.978560 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81549cc-9bc3-4104-b48e-ccb6b442a9eb None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:03.001839 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:03.008641 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7deaf1-c7ba-4445-b05e-1a5991dd4c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:03.009625 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7deaf1-c7ba-4445-b05e-1a5991dd4c5c None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:03.010084 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7deaf1-c7ba-4445-b05e-1a5991dd4c5c None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:03.010448 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7deaf1-c7ba-4445-b05e-1a5991dd4c5c None admin] PATH_INFO: `/v3/projects` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:03.011578 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7deaf1-c7ba-4445-b05e-1a5991dd4c5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:03.012062 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7deaf1-c7ba-4445-b05e-1a5991dd4c5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:03.014681 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7deaf1-c7ba-4445-b05e-1a5991dd4c5c None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:03.041185 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 312/628] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 27 09:40:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:03.041185 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7deaf1-c7ba-4445-b05e-1a5991dd4c5c None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:03.042164 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1698ee-3aac-4a2b-84a0-1323031444a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:03.042164 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1698ee-3aac-4a2b-84a0-1323031444a8 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:03.042164 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1698ee-3aac-4a2b-84a0-1323031444a8 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:03.042164 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1698ee-3aac-4a2b-84a0-1323031444a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:03.054182 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1698ee-3aac-4a2b-84a0-1323031444a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:03.056551 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1698ee-3aac-4a2b-84a0-1323031444a8 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:03.077174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-2c1698ee-3aac-4a2b-84a0-1323031444a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:40:03.077174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:03.077174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:03.077174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:03.077174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:03.077174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:03.077174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:03.077174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:03.077174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:03.077174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:03.077174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:03.077174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:03.077174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 09:40:03.077174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 09:40:03.077174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 09:40:03.078746 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 09:40:03.078746 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:03.078746 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:03.078746 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:03.078746 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:03.078746 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:03.078746 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:03.078746 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:03.078746 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:03.078746 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:03.078746 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:03.078746 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:03.078746 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:03.078746 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:03.078746 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:03.078746 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:03.078746 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:03.080722 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 09:40:03.080722 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 09:40:03.080722 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 09:40:03.080722 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 09:40:03.080722 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 09:40:03.080722 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 09:40:03.080722 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:40:03.080722 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:03.080722 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 317/629] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:40:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:03.080722 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1698ee-3aac-4a2b-84a0-1323031444a8 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:03.184292 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7deaf1-c7ba-4445-b05e-1a5991dd4c5c None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:03.187066 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:03.211263 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1698ee-3aac-4a2b-84a0-1323031444a8 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:03.230952 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ead7fb-de41-43fe-90f8-29a7c3cfa742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:03.231923 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ead7fb-de41-43fe-90f8-29a7c3cfa742 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:03.232353 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ead7fb-de41-43fe-90f8-29a7c3cfa742 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:03.232781 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ead7fb-de41-43fe-90f8-29a7c3cfa742 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:03.250342 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ead7fb-de41-43fe-90f8-29a7c3cfa742 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:03.252935 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ead7fb-de41-43fe-90f8-29a7c3cfa742 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:03.260232 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e335693-9a5f-47c6-b652-7250b4151b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:03.260915 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e335693-9a5f-47c6-b652-7250b4151b0d None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:03.261242 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e335693-9a5f-47c6-b652-7250b4151b0d None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:03.261634 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e335693-9a5f-47c6-b652-7250b4151b0d None admin] PATH_INFO: `/v3/projects` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:03.262451 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e335693-9a5f-47c6-b652-7250b4151b0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:03.262915 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e335693-9a5f-47c6-b652-7250b4151b0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:03.264576 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e335693-9a5f-47c6-b652-7250b4151b0d None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:03.270558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-c1ead7fb-de41-43fe-90f8-29a7c3cfa742 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:40:03.270558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:03.270558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:03.270558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:03.270558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:03.270558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:03.270558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:03.270558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:03.270558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:03.270558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:03.270558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:03.270558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:03.270558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:40:03.270558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:40:03.270558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:40:03.270558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:40:03.272669 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:03.272669 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:03.272669 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:03.272669 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:03.272669 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:03.272669 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:03.272669 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:03.272669 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:03.272669 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:03.272669 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:03.272669 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:03.272669 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:03.272669 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:03.272669 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:03.272669 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:03.272669 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:03.272669 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:40:03.274180 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:40:03.274180 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:40:03.274180 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:03.274180 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 313/630] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:03.274180 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ead7fb-de41-43fe-90f8-29a7c3cfa742 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:03.281695 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 318/631] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 27 09:40:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:03.282324 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e335693-9a5f-47c6-b652-7250b4151b0d None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:03.319787 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:03.413659 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ead7fb-de41-43fe-90f8-29a7c3cfa742 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:03.422307 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e335693-9a5f-47c6-b652-7250b4151b0d None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:03.454085 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6eeeb-4ed0-4735-853d-b097f0afb601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:03.454698 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6eeeb-4ed0-4735-853d-b097f0afb601 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:03.455002 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6eeeb-4ed0-4735-853d-b097f0afb601 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:03.455271 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6eeeb-4ed0-4735-853d-b097f0afb601 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:03.456005 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6eeeb-4ed0-4735-853d-b097f0afb601 None admin] RBAC: Adding query filter params (role.id=a3ad332ff078405ebc48aa8df0035cab, scope.project.id=dbe5c492b05e40448942bb2500c185ee, user.id=5a8283aa6cda48fa9a6b2f42fc498238) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:03.456313 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6eeeb-4ed0-4735-853d-b097f0afb601 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:03.457801 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6eeeb-4ed0-4735-853d-b097f0afb601 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:03.465371 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 314/632] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:40:03 2022] GET /identity/v3/role_assignments?user.id=5a8283aa6cda48fa9a6b2f42fc498238&scope.project.id=dbe5c492b05e40448942bb2500c185ee&role.id=a3ad332ff078405ebc48aa8df0035cab => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:03.466134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6eeeb-4ed0-4735-853d-b097f0afb601 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:03.469036 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec9c19-9db3-417e-a112-fe98f1ddbe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:03.470085 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec9c19-9db3-417e-a112-fe98f1ddbe48 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:03.470524 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec9c19-9db3-417e-a112-fe98f1ddbe48 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:03.471025 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec9c19-9db3-417e-a112-fe98f1ddbe48 None admin] PATH_INFO: `/v3/projects` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:03.472979 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec9c19-9db3-417e-a112-fe98f1ddbe48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:03.472979 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec9c19-9db3-417e-a112-fe98f1ddbe48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:03.475176 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec9c19-9db3-417e-a112-fe98f1ddbe48 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:03.493441 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:03.496254 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 319/633] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 27 09:40:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:03.497554 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec9c19-9db3-417e-a112-fe98f1ddbe48 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:03.608652 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6eeeb-4ed0-4735-853d-b097f0afb601 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:03.638661 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:03.651404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec9c19-9db3-417e-a112-fe98f1ddbe48 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:03.655062 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530ad02-6053-4063-8c01-979d62adda02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:03.655696 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530ad02-6053-4063-8c01-979d62adda02 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:03.655966 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530ad02-6053-4063-8c01-979d62adda02 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:03.656239 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530ad02-6053-4063-8c01-979d62adda02 None admin] PATH_INFO: `/v3/domains` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:03.656896 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7530ad02-6053-4063-8c01-979d62adda02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:03.657193 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7530ad02-6053-4063-8c01-979d62adda02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:03.658633 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7530ad02-6053-4063-8c01-979d62adda02 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:03.675008 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 315/634] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:03.676016 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530ad02-6053-4063-8c01-979d62adda02 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:03.706729 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9a622-da80-4cff-924a-f9700b334e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:03.707801 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9a622-da80-4cff-924a-f9700b334e52 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:03.708330 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9a622-da80-4cff-924a-f9700b334e52 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:03.708970 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9a622-da80-4cff-924a-f9700b334e52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:03.710194 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9a622-da80-4cff-924a-f9700b334e52 None admin] RBAC: Adding query filter params (role.id=a3ad332ff078405ebc48aa8df0035cab, scope.project.id=dbe5c492b05e40448942bb2500c185ee, user.id=25ffb8d1c3014daab3b00e2a059af76b) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:03.710505 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9a622-da80-4cff-924a-f9700b334e52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:03.712077 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9a622-da80-4cff-924a-f9700b334e52 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:03.720143 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 320/635] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:40:03 2022] GET /identity/v3/role_assignments?user.id=25ffb8d1c3014daab3b00e2a059af76b&scope.project.id=dbe5c492b05e40448942bb2500c185ee&role.id=a3ad332ff078405ebc48aa8df0035cab => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:03.721217 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9a622-da80-4cff-924a-f9700b334e52 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:03.788418 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:03.827207 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530ad02-6053-4063-8c01-979d62adda02 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:03.898668 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a8437-7728-4f39-82ca-ea3a2bc98d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:03.899757 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a8437-7728-4f39-82ca-ea3a2bc98d20 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:03.900236 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a8437-7728-4f39-82ca-ea3a2bc98d20 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:03.900594 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9a622-da80-4cff-924a-f9700b334e52 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:03.900752 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a8437-7728-4f39-82ca-ea3a2bc98d20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:03.902328 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a8437-7728-4f39-82ca-ea3a2bc98d20 None admin] RBAC: Adding query filter params (role.id=a3ad332ff078405ebc48aa8df0035cab, scope.project.id=dbe5c492b05e40448942bb2500c185ee, user.id=bda026ed208d4736938da05121a06f4e) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:03.902861 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a8437-7728-4f39-82ca-ea3a2bc98d20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:03.905847 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a8437-7728-4f39-82ca-ea3a2bc98d20 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:03.921072 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 316/636] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:40:03 2022] GET /identity/v3/role_assignments?user.id=bda026ed208d4736938da05121a06f4e&scope.project.id=dbe5c492b05e40448942bb2500c185ee&role.id=a3ad332ff078405ebc48aa8df0035cab => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:03.964899 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b024b1b-1870-4565-aa12-5beea4883d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:03.966369 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b024b1b-1870-4565-aa12-5beea4883d41 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:03.967066 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b024b1b-1870-4565-aa12-5beea4883d41 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:03.967812 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b024b1b-1870-4565-aa12-5beea4883d41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:03.982797 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b024b1b-1870-4565-aa12-5beea4883d41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:03.985667 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b024b1b-1870-4565-aa12-5beea4883d41 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:04.009125 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-4b024b1b-1870-4565-aa12-5beea4883d41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:40:04.009125 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:04.009125 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:04.009125 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:04.009125 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:04.009125 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:04.009125 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:04.009125 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:04.009125 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:04.009125 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:04.009125 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:04.009125 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:04.009125 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 09:40:04.009125 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 09:40:04.009125 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 09:40:04.010904 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 09:40:04.010904 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:04.010904 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:04.010904 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:04.010904 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:04.010904 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:04.010904 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:04.010904 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:04.010904 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:04.010904 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:04.010904 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:04.010904 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:04.010904 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:04.010904 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:04.010904 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:04.010904 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:04.010904 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:04.012690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 09:40:04.012690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 09:40:04.012690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 09:40:04.012690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 09:40:04.012690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 09:40:04.012690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 09:40:04.012690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:40:04.012690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:04.016176 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 321/637] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:40:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:04.025636 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a8437-7728-4f39-82ca-ea3a2bc98d20 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:04.213226 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a8437-7728-4f39-82ca-ea3a2bc98d20 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:04.264383 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f30371-0024-4f50-814d-0f89f7599d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:04.265010 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f30371-0024-4f50-814d-0f89f7599d03 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:04.265298 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f30371-0024-4f50-814d-0f89f7599d03 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:04.265562 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f30371-0024-4f50-814d-0f89f7599d03 None admin] PATH_INFO: `/v3/projects` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:04.266270 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f30371-0024-4f50-814d-0f89f7599d03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:04.266568 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f30371-0024-4f50-814d-0f89f7599d03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:04.268089 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f30371-0024-4f50-814d-0f89f7599d03 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:04.282689 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 317/638] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 27 09:40:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:04.290057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b024b1b-1870-4565-aa12-5beea4883d41 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:04.318438 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:04.479575 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b024b1b-1870-4565-aa12-5beea4883d41 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:04.554757 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b05c1-235d-4496-aca9-1de5b9689e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:04.556289 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b05c1-235d-4496-aca9-1de5b9689e92 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:04.557031 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b05c1-235d-4496-aca9-1de5b9689e92 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:04.557779 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b05c1-235d-4496-aca9-1de5b9689e92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:04.559592 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b05c1-235d-4496-aca9-1de5b9689e92 None admin] RBAC: Adding query filter params (role.id=a3ad332ff078405ebc48aa8df0035cab, scope.project.id=dbe5c492b05e40448942bb2500c185ee, user.id=1575d436c7d043d886293e24fa5f64fb) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:04.560422 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b05c1-235d-4496-aca9-1de5b9689e92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:04.563697 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b05c1-235d-4496-aca9-1de5b9689e92 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:04.576214 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 322/639] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:40:04 2022] GET /identity/v3/role_assignments?user.id=1575d436c7d043d886293e24fa5f64fb&scope.project.id=dbe5c492b05e40448942bb2500c185ee&role.id=a3ad332ff078405ebc48aa8df0035cab => generated 608 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:06.740056 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ae4c3-033f-4f00-997c-2cba61650ee4 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:06.741051 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ae4c3-033f-4f00-997c-2cba61650ee4 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:06.741505 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ae4c3-033f-4f00-997c-2cba61650ee4 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:06.743470 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 318/640] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:40:06.749646 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf895b2-aac9-46b2-b143-e68d0d86a8df None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:06.750544 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf895b2-aac9-46b2-b143-e68d0d86a8df None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:06.751023 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf895b2-aac9-46b2-b143-e68d0d86a8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:06.772119 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-fbf895b2-aac9-46b2-b143-e68d0d86a8df None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:06.773658 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-fbf895b2-aac9-46b2-b143-e68d0d86a8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:06.851080 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 323/641] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 09:40:07.041433 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac3456-a1f0-4062-87f5-861812c3d8f3 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:07.041718 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac3456-a1f0-4062-87f5-861812c3d8f3 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:07.042139 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac3456-a1f0-4062-87f5-861812c3d8f3 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:07.044008 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 319/642] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:40:07.050031 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67ac90-eaa2-4989-8647-554bb24180be None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:07.050630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67ac90-eaa2-4989-8647-554bb24180be None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:07.051158 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67ac90-eaa2-4989-8647-554bb24180be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:07.071970 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-4c67ac90-eaa2-4989-8647-554bb24180be None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:07.073587 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-4c67ac90-eaa2-4989-8647-554bb24180be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:07.077899 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:07.148619 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 324/643] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:40:07.191878 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac3456-a1f0-4062-87f5-861812c3d8f3 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:07.195742 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:07.388357 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac3456-a1f0-4062-87f5-861812c3d8f3 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:07.453746 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f67bc0-a588-452d-b1e6-4b19e025cd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:07.454633 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f67bc0-a588-452d-b1e6-4b19e025cd00 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:07.455084 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f67bc0-a588-452d-b1e6-4b19e025cd00 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:07.455495 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f67bc0-a588-452d-b1e6-4b19e025cd00 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:07.456501 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f67bc0-a588-452d-b1e6-4b19e025cd00 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:07.459345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f67bc0-a588-452d-b1e6-4b19e025cd00 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:07.467897 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67ac90-eaa2-4989-8647-554bb24180be None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:07.478520 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-d7f67bc0-a588-452d-b1e6-4b19e025cd00 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 09:40:07.478520 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:07.478520 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 09:40:07.478520 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 09:40:07.478520 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 09:40:07.478520 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 09:40:07.478520 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 09:40:07.478520 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:07.478520 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 09:40:07.478520 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:07.478520 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 09:40:07.478520 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:07.478520 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:07.478520 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:07.478520 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:07.478520 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:07.478520 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:07.479674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:07.479674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:07.479674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:07.479674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:07.479674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:07.479674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:07.479674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 09:40:07.479674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 09:40:07.479674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 09:40:07.479674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 09:40:07.479674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:07.479674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:07.479674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:07.479674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:07.479674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:07.479674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:07.480592 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:07.480592 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:07.480592 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:07.480592 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:07.480592 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:07.480592 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:07.480592 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:07.480592 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:07.480592 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:07.480592 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:07.480592 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 09:40:07.480592 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:07.480592 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 09:40:07.480592 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:07.480592 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 320/644] 10.222.0.49 () {56 vars in 1129 bytes} [Tue Sep 27 09:40:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 09:40:07.487850 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f67bc0-a588-452d-b1e6-4b19e025cd00 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:07.601633 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:07.647330 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67ac90-eaa2-4989-8647-554bb24180be None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:07.651513 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f67bc0-a588-452d-b1e6-4b19e025cd00 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:07.694597 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ae003-5307-44bb-bf88-15609de6b216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:07.695220 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180739e8-a393-48a6-a26f-eeb4544c3c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:07.695464 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ae003-5307-44bb-bf88-15609de6b216 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:07.695616 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ae003-5307-44bb-bf88-15609de6b216 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:07.695877 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ae003-5307-44bb-bf88-15609de6b216 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:07.696129 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180739e8-a393-48a6-a26f-eeb4544c3c2b None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:07.696497 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180739e8-a393-48a6-a26f-eeb4544c3c2b None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:07.696900 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180739e8-a393-48a6-a26f-eeb4544c3c2b None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:07.697629 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180739e8-a393-48a6-a26f-eeb4544c3c2b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:07.698114 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180739e8-a393-48a6-a26f-eeb4544c3c2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:07.699837 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180739e8-a393-48a6-a26f-eeb4544c3c2b None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:07.705361 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 321/645] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Sep 27 09:40:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:07.706518 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103906a-7c96-49bf-b2a0-f1bfe58c3304 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:07.706829 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103906a-7c96-49bf-b2a0-f1bfe58c3304 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:07.707101 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103906a-7c96-49bf-b2a0-f1bfe58c3304 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:07.708608 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:07.709020 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 322/646] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:40:07.710146 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1f158-c68c-4620-a22a-b0aeae179118 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:07.710424 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1f158-c68c-4620-a22a-b0aeae179118 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:07.710693 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1f158-c68c-4620-a22a-b0aeae179118 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:07.711966 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 323/647] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:40:07.717093 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1f158-c68c-4620-a22a-b0aeae179118 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:07.719769 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ae003-5307-44bb-bf88-15609de6b216 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:40:07.726539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-9d7ae003-5307-44bb-bf88-15609de6b216 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:40:07.726539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:07.726539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:07.726539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:07.726539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:07.726539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:07.726539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:07.726539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:07.726539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:07.726539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:07.726539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:07.726539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:07.726539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:40:07.726539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:40:07.726539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:40:07.726539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:40:07.727756 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:40:07.727756 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:40:07.727756 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:40:07.727756 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:40:07.727756 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:07.727756 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:07.727756 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:07.727756 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:07.727756 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:07.727756 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:07.727756 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:07.727756 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:07.727756 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:07.727756 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:07.727756 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:07.727756 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:07.728999 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:07.728999 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:07.728999 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:07.728999 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:07.728999 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:40:07.728999 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:40:07.728999 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:40:07.728999 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:40:07.728999 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:40:07.728999 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:40:07.728999 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:40:07.728999 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:07.728999 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 325/648] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 27 09:40:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 09:40:07.730282 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbebebb-b851-4ccc-a4aa-f8c077a1e127 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:07.730797 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbebebb-b851-4ccc-a4aa-f8c077a1e127 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:07.731182 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbebebb-b851-4ccc-a4aa-f8c077a1e127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:07.752532 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-cdbebebb-b851-4ccc-a4aa-f8c077a1e127 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:07.753740 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-cdbebebb-b851-4ccc-a4aa-f8c077a1e127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:07.828749 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 326/649] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:40:07.830204 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f930cd-5658-4e90-9fae-946348950193 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:07.830495 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f930cd-5658-4e90-9fae-946348950193 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:07.830797 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f930cd-5658-4e90-9fae-946348950193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:07.846876 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1f158-c68c-4620-a22a-b0aeae179118 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:07.849561 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-f1f930cd-5658-4e90-9fae-946348950193 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:07.850950 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-f1f930cd-5658-4e90-9fae-946348950193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:07.892879 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:07.901705 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715c875-321e-4064-b9d1-7098efcf50d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:07.902382 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715c875-321e-4064-b9d1-7098efcf50d8 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:07.902924 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715c875-321e-4064-b9d1-7098efcf50d8 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:07.903620 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715c875-321e-4064-b9d1-7098efcf50d8 None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:07.904269 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715c875-321e-4064-b9d1-7098efcf50d8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:07.904569 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715c875-321e-4064-b9d1-7098efcf50d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:07.905956 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715c875-321e-4064-b9d1-7098efcf50d8 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:07.912574 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 324/650] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Sep 27 09:40:07 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:40:07.920198 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715c875-321e-4064-b9d1-7098efcf50d8 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:07.963158 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 327/651] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:40:08.038725 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715c875-321e-4064-b9d1-7098efcf50d8 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:08.080363 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf0c26-5e5d-4b45-973c-abf3ebc126f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:08.081418 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf0c26-5e5d-4b45-973c-abf3ebc126f7 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:08.081907 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf0c26-5e5d-4b45-973c-abf3ebc126f7 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:08.082430 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf0c26-5e5d-4b45-973c-abf3ebc126f7 None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:08.083652 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf0c26-5e5d-4b45-973c-abf3ebc126f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:08.084268 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf0c26-5e5d-4b45-973c-abf3ebc126f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:08.086012 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf0c26-5e5d-4b45-973c-abf3ebc126f7 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:08.096442 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 325/652] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:40:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:08.105350 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f930cd-5658-4e90-9fae-946348950193 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:08.168571 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf0c26-5e5d-4b45-973c-abf3ebc126f7 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:08.218587 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:08.246473 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:08.301089 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f930cd-5658-4e90-9fae-946348950193 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:08.304137 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf0c26-5e5d-4b45-973c-abf3ebc126f7 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:08.347899 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8f421-1d67-48ea-875a-299ff5c57dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:08.348540 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8f421-1d67-48ea-875a-299ff5c57dbd None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:08.348992 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8f421-1d67-48ea-875a-299ff5c57dbd None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:08.349986 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8f421-1d67-48ea-875a-299ff5c57dbd None admin] PATH_INFO: `/v3/services/image` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:08.349986 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8f421-1d67-48ea-875a-299ff5c57dbd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:08.351326 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8f421-1d67-48ea-875a-299ff5c57dbd None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:08.352852 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13bc71-bb75-4317-a4c4-e948803804cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:08.353499 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13bc71-bb75-4317-a4c4-e948803804cf None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:08.353776 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13bc71-bb75-4317-a4c4-e948803804cf None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:08.354036 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13bc71-bb75-4317-a4c4-e948803804cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:08.362254 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-e2d8f421-1d67-48ea-875a-299ff5c57dbd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 09:40:08.362254 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:08.362254 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 09:40:08.362254 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 09:40:08.362254 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 09:40:08.362254 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 09:40:08.362254 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 09:40:08.362254 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:08.362254 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 09:40:08.362254 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:08.362254 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 09:40:08.362254 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:08.362254 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:08.362254 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:08.362254 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:08.362254 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:08.362254 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:08.363720 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:08.363720 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:08.363720 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:08.363720 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:08.363720 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:08.363720 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:08.363720 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 09:40:08.363720 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 09:40:08.363720 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 09:40:08.363720 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 09:40:08.363720 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:08.363720 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:08.363720 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:08.363720 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:08.363720 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:08.363720 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:08.366197 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:08.366197 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:08.366197 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:08.366197 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:08.366197 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:08.366197 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:08.366197 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:08.366197 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:08.366197 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:08.366197 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:08.366197 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 09:40:08.366197 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:08.366197 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 09:40:08.366197 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:08.369243 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 326/653] 10.222.0.49 () {56 vars in 1105 bytes} [Tue Sep 27 09:40:08 2022] GET /identity/v3/services/image => generated 86 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:08.369596 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8f421-1d67-48ea-875a-299ff5c57dbd None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:08.370597 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc13bc71-bb75-4317-a4c4-e948803804cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:08.372121 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc13bc71-bb75-4317-a4c4-e948803804cf None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:08.393296 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-bc13bc71-bb75-4317-a4c4-e948803804cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:40:08.393296 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:08.393296 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:08.393296 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:08.393296 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:08.393296 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:08.393296 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:08.393296 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:08.393296 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:08.393296 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:08.393296 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:08.393296 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:08.393296 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:40:08.393296 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:40:08.393296 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:40:08.393296 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:40:08.394335 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:08.394335 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:08.394335 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:08.394335 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:08.394335 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:08.394335 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:08.394335 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:08.394335 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:08.394335 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:08.394335 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:08.394335 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:08.394335 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:08.394335 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:08.394335 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:08.394335 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:08.394335 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:08.394335 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:40:08.395288 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:40:08.395288 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:40:08.395288 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:08.395288 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 328/654] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:40:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:08.395288 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13bc71-bb75-4317-a4c4-e948803804cf None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:08.497079 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8f421-1d67-48ea-875a-299ff5c57dbd None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:08.523986 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:08.553404 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a58e24-22c1-4cbb-ab63-225985ef3890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:08.554640 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a58e24-22c1-4cbb-ab63-225985ef3890 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:08.559899 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a58e24-22c1-4cbb-ab63-225985ef3890 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:08.559899 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a58e24-22c1-4cbb-ab63-225985ef3890 None admin] PATH_INFO: `/v3/services/network` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:08.559899 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a58e24-22c1-4cbb-ab63-225985ef3890 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:08.559899 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a58e24-22c1-4cbb-ab63-225985ef3890 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:08.576712 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-91a58e24-22c1-4cbb-ab63-225985ef3890 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 09:40:08.576712 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:08.576712 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 09:40:08.576712 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 09:40:08.576712 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 09:40:08.576712 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 09:40:08.576712 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 09:40:08.576712 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:08.576712 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 09:40:08.576712 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:08.576712 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 09:40:08.576712 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:08.576712 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:08.576712 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:08.576712 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:08.576712 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:08.576712 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:08.577773 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:08.577773 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:08.577773 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:08.577773 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:08.577773 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:08.577773 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:08.577773 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 09:40:08.577773 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 09:40:08.577773 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 09:40:08.577773 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 09:40:08.577773 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:08.577773 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:08.577773 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:08.577773 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:08.577773 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:08.577773 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:08.578611 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:08.578611 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:08.578611 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:08.578611 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:08.578611 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:08.578611 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:08.578611 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:08.578611 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:08.578611 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:08.578611 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:08.578611 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 09:40:08.578611 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:08.578611 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 09:40:08.578611 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:08.579475 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 327/655] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:40:08 2022] GET /identity/v3/services/network => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:08.580386 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a58e24-22c1-4cbb-ab63-225985ef3890 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:08.589115 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13bc71-bb75-4317-a4c4-e948803804cf None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:08.605598 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:08.632982 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46735a-a742-4ada-8af5-c239b5be19ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:08.634129 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46735a-a742-4ada-8af5-c239b5be19ff None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:08.634638 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46735a-a742-4ada-8af5-c239b5be19ff None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:08.635302 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46735a-a742-4ada-8af5-c239b5be19ff None admin] PATH_INFO: `/v3/services` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:08.636361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46735a-a742-4ada-8af5-c239b5be19ff None admin] RBAC: Adding query filter params (name=image) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:08.637017 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46735a-a742-4ada-8af5-c239b5be19ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:08.638828 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46735a-a742-4ada-8af5-c239b5be19ff None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:08.646213 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 329/656] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:40:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:08.648119 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46735a-a742-4ada-8af5-c239b5be19ff None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:08.751410 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a58e24-22c1-4cbb-ab63-225985ef3890 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:08.790899 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2022379-d52e-49fd-ad5f-8e6654ef2189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:08.791522 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2022379-d52e-49fd-ad5f-8e6654ef2189 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:08.791804 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2022379-d52e-49fd-ad5f-8e6654ef2189 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:08.792060 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2022379-d52e-49fd-ad5f-8e6654ef2189 None admin] PATH_INFO: `/v3/domains` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:08.792716 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2022379-d52e-49fd-ad5f-8e6654ef2189 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:08.793013 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2022379-d52e-49fd-ad5f-8e6654ef2189 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:08.794398 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2022379-d52e-49fd-ad5f-8e6654ef2189 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:08.795669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46735a-a742-4ada-8af5-c239b5be19ff None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:08.810824 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 328/657] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:08.811784 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2022379-d52e-49fd-ad5f-8e6654ef2189 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:08.852787 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abd679-d51c-491a-a33b-a457cf3ea10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:08.853701 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abd679-d51c-491a-a33b-a457cf3ea10f None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:08.854193 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abd679-d51c-491a-a33b-a457cf3ea10f None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:08.854652 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abd679-d51c-491a-a33b-a457cf3ea10f None admin] PATH_INFO: `/v3/services` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:08.855858 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12abd679-d51c-491a-a33b-a457cf3ea10f None admin] RBAC: Adding query filter params (name=network) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:08.856280 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12abd679-d51c-491a-a33b-a457cf3ea10f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:08.858811 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12abd679-d51c-491a-a33b-a457cf3ea10f None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:08.872504 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 330/658] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Sep 27 09:40:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:08.872504 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abd679-d51c-491a-a33b-a457cf3ea10f None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:08.875899 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:08.924888 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:08.969526 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2022379-d52e-49fd-ad5f-8e6654ef2189 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:08.993899 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abd679-d51c-491a-a33b-a457cf3ea10f None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:09.014489 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28736bcc-aa18-4df1-ac15-0db75446cb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:09.015870 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28736bcc-aa18-4df1-ac15-0db75446cb95 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:09.016535 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28736bcc-aa18-4df1-ac15-0db75446cb95 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:09.017249 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28736bcc-aa18-4df1-ac15-0db75446cb95 None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:09.018500 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28736bcc-aa18-4df1-ac15-0db75446cb95 None admin] RBAC: Adding query filter params (type=image) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:09.019293 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28736bcc-aa18-4df1-ac15-0db75446cb95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:09.021898 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28736bcc-aa18-4df1-ac15-0db75446cb95 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:09.028802 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 329/659] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:40:08 2022] GET /identity/v3/services?type=image => generated 122 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:09.029998 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28736bcc-aa18-4df1-ac15-0db75446cb95 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:09.048120 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95217960-3755-4578-8f57-316bae45ba94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:09.049541 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95217960-3755-4578-8f57-316bae45ba94 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:09.050317 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95217960-3755-4578-8f57-316bae45ba94 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:09.051028 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95217960-3755-4578-8f57-316bae45ba94 None admin] PATH_INFO: `/v3/users/nova` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:09.066470 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95217960-3755-4578-8f57-316bae45ba94 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:09.070818 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95217960-3755-4578-8f57-316bae45ba94 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:09.094268 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-95217960-3755-4578-8f57-316bae45ba94 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 09:40:09.094268 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:09.094268 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:09.094268 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:09.094268 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:09.094268 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:09.094268 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:09.094268 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:09.094268 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:09.094268 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:09.094268 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:09.094268 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:09.094268 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 09:40:09.094268 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 09:40:09.094268 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 09:40:09.094268 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 09:40:09.096317 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:09.096317 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:09.096317 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 09:40:09.096317 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:40:09.096317 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 09:40:09.096317 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:40:09.096317 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:09.096317 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:09.096317 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:09.096317 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:09.096317 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:09.096317 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:09.096317 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:09.096317 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:09.096317 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:09.096317 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:09.096317 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:09.096317 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:09.098183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:09.098183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:09.098183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 09:40:09.098183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 09:40:09.098183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 09:40:09.098183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 09:40:09.098183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 09:40:09.098183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 09:40:09.098183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 09:40:09.098183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:09.110971 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 331/660] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Sep 27 09:40:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:09.112993 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95217960-3755-4578-8f57-316bae45ba94 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:09.241525 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28736bcc-aa18-4df1-ac15-0db75446cb95 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:09.256452 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:09.275688 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:09.281267 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95217960-3755-4578-8f57-316bae45ba94 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:09.306389 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d4065-1426-45c1-9e3a-d22fb65b5095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:09.307169 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d4065-1426-45c1-9e3a-d22fb65b5095 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:09.307442 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d4065-1426-45c1-9e3a-d22fb65b5095 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:09.307707 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d4065-1426-45c1-9e3a-d22fb65b5095 None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:09.308358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d4065-1426-45c1-9e3a-d22fb65b5095 None admin] RBAC: Adding query filter params (type=network) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:09.308764 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d4065-1426-45c1-9e3a-d22fb65b5095 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:09.310783 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d4065-1426-45c1-9e3a-d22fb65b5095 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:09.319047 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 330/661] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Sep 27 09:40:09 2022] GET /identity/v3/services?type=network => generated 124 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:09.345052 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5421c5f-59d2-497e-ae99-2c7cbe2c7b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:09.346177 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5421c5f-59d2-497e-ae99-2c7cbe2c7b29 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:09.346679 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5421c5f-59d2-497e-ae99-2c7cbe2c7b29 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:09.347276 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5421c5f-59d2-497e-ae99-2c7cbe2c7b29 None admin] PATH_INFO: `/v3/users` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:09.348624 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5421c5f-59d2-497e-ae99-2c7cbe2c7b29 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:09.351432 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5421c5f-59d2-497e-ae99-2c7cbe2c7b29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:09.352483 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5421c5f-59d2-497e-ae99-2c7cbe2c7b29 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:09.385325 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 332/662] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Sep 27 09:40:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:09.395226 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d4065-1426-45c1-9e3a-d22fb65b5095 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:09.529726 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d4065-1426-45c1-9e3a-d22fb65b5095 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:09.588043 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456d417-f007-4a6a-9989-a44f94fb7a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:09.591361 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456d417-f007-4a6a-9989-a44f94fb7a5d None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:09.591361 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456d417-f007-4a6a-9989-a44f94fb7a5d None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:09.591361 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456d417-f007-4a6a-9989-a44f94fb7a5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:09.671183 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:09.718821 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456d417-f007-4a6a-9989-a44f94fb7a5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:09.720792 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456d417-f007-4a6a-9989-a44f94fb7a5d None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:09.851093 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 331/663] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:40:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 27 09:40:09.854120 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5421c5f-59d2-497e-ae99-2c7cbe2c7b29 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:09.981368 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5421c5f-59d2-497e-ae99-2c7cbe2c7b29 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:10.020104 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f56927-bcbc-4e52-bf06-6d87932348ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:10.021084 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f56927-bcbc-4e52-bf06-6d87932348ee None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:10.021503 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f56927-bcbc-4e52-bf06-6d87932348ee None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:10.021935 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f56927-bcbc-4e52-bf06-6d87932348ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:10.033675 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f56927-bcbc-4e52-bf06-6d87932348ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:10.035562 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f56927-bcbc-4e52-bf06-6d87932348ee None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:10.053237 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-e9f56927-bcbc-4e52-bf06-6d87932348ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:40:10.053237 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:10.053237 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:10.053237 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:10.053237 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:10.053237 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:10.053237 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:10.053237 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:10.053237 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:10.053237 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:10.053237 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:10.053237 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:10.053237 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:40:10.053237 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:40:10.053237 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:40:10.053237 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:40:10.054474 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:10.054474 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:10.054474 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:10.054474 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:10.054474 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:10.054474 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:10.054474 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:10.054474 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:10.054474 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:10.054474 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:10.054474 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:10.054474 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:10.054474 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:10.054474 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:10.054474 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:10.054474 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:10.054474 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:40:10.055629 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:40:10.055629 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:40:10.055629 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:10.057736 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 333/664] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:40:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 09:40:10.063861 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456d417-f007-4a6a-9989-a44f94fb7a5d None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:10.148575 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:10.183495 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456d417-f007-4a6a-9989-a44f94fb7a5d None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:10.221555 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71f78d-f947-4264-9cc5-b6f8ca5eb677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:10.222188 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71f78d-f947-4264-9cc5-b6f8ca5eb677 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:10.222465 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71f78d-f947-4264-9cc5-b6f8ca5eb677 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:10.222740 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71f78d-f947-4264-9cc5-b6f8ca5eb677 None admin] PATH_INFO: `/v3/domains` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:10.223419 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f71f78d-f947-4264-9cc5-b6f8ca5eb677 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:10.224082 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f71f78d-f947-4264-9cc5-b6f8ca5eb677 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:10.225633 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f71f78d-f947-4264-9cc5-b6f8ca5eb677 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:10.243299 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 332/665] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:40:10.245061 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f56927-bcbc-4e52-bf06-6d87932348ee None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:10.269712 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:10.355842 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f56927-bcbc-4e52-bf06-6d87932348ee None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:10.393293 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f640a-6f5d-44b8-a996-8fab7bae207f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:10.394332 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f640a-6f5d-44b8-a996-8fab7bae207f None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:10.394865 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f640a-6f5d-44b8-a996-8fab7bae207f None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:10.395390 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f640a-6f5d-44b8-a996-8fab7bae207f None admin] PATH_INFO: `/v3/projects/service` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:10.403928 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f640a-6f5d-44b8-a996-8fab7bae207f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:10.405739 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f640a-6f5d-44b8-a996-8fab7bae207f None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:10.419021 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-7a9f640a-6f5d-44b8-a996-8fab7bae207f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:40:10.419021 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:10.419021 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:10.419021 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:10.419021 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:10.419021 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:10.419021 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:10.419021 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:10.419021 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:10.419021 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:10.419021 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:10.419021 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:10.419021 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 09:40:10.419021 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 09:40:10.419021 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 09:40:10.419952 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 09:40:10.419952 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:10.419952 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:10.419952 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:10.419952 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:10.419952 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:10.419952 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:10.419952 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:10.419952 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:10.419952 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:10.419952 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:10.419952 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:10.419952 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:10.419952 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:10.419952 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:10.419952 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:10.419952 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:10.420930 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 09:40:10.420930 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 09:40:10.420930 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 09:40:10.420930 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 09:40:10.420930 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 09:40:10.420930 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 09:40:10.420930 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:40:10.420930 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:10.423470 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 334/666] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:40:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:10.432247 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71f78d-f947-4264-9cc5-b6f8ca5eb677 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:10.543905 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71f78d-f947-4264-9cc5-b6f8ca5eb677 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:10.547575 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f479b-4fb0-4196-9e15-6280d3dfec9c None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:10.547870 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f479b-4fb0-4196-9e15-6280d3dfec9c None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:10.548121 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f479b-4fb0-4196-9e15-6280d3dfec9c None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:10.549604 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 335/667] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:40:10.555677 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf7011-b49c-429e-8fbd-8daf55bc7b54 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:10.556279 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf7011-b49c-429e-8fbd-8daf55bc7b54 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:10.556823 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf7011-b49c-429e-8fbd-8daf55bc7b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:10.577262 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-efcf7011-b49c-429e-8fbd-8daf55bc7b54 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:10.577914 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:10.580553 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-efcf7011-b49c-429e-8fbd-8daf55bc7b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:10.596723 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20782bd4-c025-46ec-aa2e-6c6654646eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:10.598088 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20782bd4-c025-46ec-aa2e-6c6654646eb8 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:10.599548 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20782bd4-c025-46ec-aa2e-6c6654646eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:10.600045 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20782bd4-c025-46ec-aa2e-6c6654646eb8 None admin] PATH_INFO: `/v3/projects` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:10.601443 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20782bd4-c025-46ec-aa2e-6c6654646eb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:10.602142 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20782bd4-c025-46ec-aa2e-6c6654646eb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:10.603837 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20782bd4-c025-46ec-aa2e-6c6654646eb8 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:10.618641 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 333/668] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 27 09:40:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:10.628404 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20782bd4-c025-46ec-aa2e-6c6654646eb8 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:10.674725 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:10.687182 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 336/669] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:40:10.751206 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20782bd4-c025-46ec-aa2e-6c6654646eb8 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:10.802979 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d534f-7c72-4e04-b1f2-efeddb715ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:10.803615 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d534f-7c72-4e04-b1f2-efeddb715ec4 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:10.803892 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d534f-7c72-4e04-b1f2-efeddb715ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:10.804168 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d534f-7c72-4e04-b1f2-efeddb715ec4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:10.804982 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d534f-7c72-4e04-b1f2-efeddb715ec4 None admin] RBAC: Adding query filter params (role.id=7cc7d3c85c794033b590117321e97ccf, scope.project.id=dbe5c492b05e40448942bb2500c185ee, user.id=bda026ed208d4736938da05121a06f4e) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:10.805293 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d534f-7c72-4e04-b1f2-efeddb715ec4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:10.806944 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d534f-7c72-4e04-b1f2-efeddb715ec4 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:10.813879 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 334/670] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:40:10 2022] GET /identity/v3/role_assignments?user.id=bda026ed208d4736938da05121a06f4e&scope.project.id=dbe5c492b05e40448942bb2500c185ee&role.id=7cc7d3c85c794033b590117321e97ccf => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:11.043760 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf7011-b49c-429e-8fbd-8daf55bc7b54 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:11.155428 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf7011-b49c-429e-8fbd-8daf55bc7b54 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:11.194414 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34561de0-0484-4e7b-85b0-733b5ce6a5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:11.195084 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34561de0-0484-4e7b-85b0-733b5ce6a5ce None admin] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:11.195363 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34561de0-0484-4e7b-85b0-733b5ce6a5ce None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:11.195634 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34561de0-0484-4e7b-85b0-733b5ce6a5ce None admin] PATH_INFO: `/v3/services` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:11.196309 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34561de0-0484-4e7b-85b0-733b5ce6a5ce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:11.197779 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34561de0-0484-4e7b-85b0-733b5ce6a5ce None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:11.224262 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 337/671] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Sep 27 09:40:11 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:40:11.975346 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392188bd-97b3-4114-aa54-5aa8768d320d None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:11.976132 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392188bd-97b3-4114-aa54-5aa8768d320d None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:11.976132 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392188bd-97b3-4114-aa54-5aa8768d320d None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:11.977718 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 335/672] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:40:11.983459 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1bba8-ef4f-4541-aa4b-df66ec473ab5 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:11.983813 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1bba8-ef4f-4541-aa4b-df66ec473ab5 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:11.984066 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1bba8-ef4f-4541-aa4b-df66ec473ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:12.004676 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-b2a1bba8-ef4f-4541-aa4b-df66ec473ab5 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:12.005947 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-b2a1bba8-ef4f-4541-aa4b-df66ec473ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:12.072538 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:12.100875 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 338/673] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:11 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:40:12.176772 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad926b3-6df8-47e5-ab98-2a133c3ef1ec None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:12.177431 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad926b3-6df8-47e5-ab98-2a133c3ef1ec None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:12.177850 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad926b3-6df8-47e5-ab98-2a133c3ef1ec None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:12.180141 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 336/674] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:40:12.189675 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15c29c-8cbf-4ee8-bef0-5c40d5b71345 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:12.190087 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15c29c-8cbf-4ee8-bef0-5c40d5b71345 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:12.190272 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15c29c-8cbf-4ee8-bef0-5c40d5b71345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:12.213665 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-0b15c29c-8cbf-4ee8-bef0-5c40d5b71345 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:12.215053 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-0b15c29c-8cbf-4ee8-bef0-5c40d5b71345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:12.295173 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 339/675] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:12 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 09:40:12.563935 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad926b3-6df8-47e5-ab98-2a133c3ef1ec None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:12.631759 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:12.673062 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15c29c-8cbf-4ee8-bef0-5c40d5b71345 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:12.682848 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad926b3-6df8-47e5-ab98-2a133c3ef1ec None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:12.747470 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55388c7-8a0e-46e8-a867-84a3a7e22fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:12.748113 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55388c7-8a0e-46e8-a867-84a3a7e22fd9 None admin] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:12.748412 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55388c7-8a0e-46e8-a867-84a3a7e22fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:12.748644 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55388c7-8a0e-46e8-a867-84a3a7e22fd9 None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:12.749301 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55388c7-8a0e-46e8-a867-84a3a7e22fd9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:12.750750 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55388c7-8a0e-46e8-a867-84a3a7e22fd9 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:12.790819 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 337/676] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Sep 27 09:40:12 2022] POST /identity/v3/services => generated 240 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:40:12.846093 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15c29c-8cbf-4ee8-bef0-5c40d5b71345 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:12.882109 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:12.927183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92172b-79a4-4d83-b258-4502eed8de19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:12.928373 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92172b-79a4-4d83-b258-4502eed8de19 None admin] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:12.928859 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92172b-79a4-4d83-b258-4502eed8de19 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:12.929443 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92172b-79a4-4d83-b258-4502eed8de19 None admin] PATH_INFO: `/v3/services` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:12.930609 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92172b-79a4-4d83-b258-4502eed8de19 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:12.933224 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92172b-79a4-4d83-b258-4502eed8de19 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:12.961967 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 340/677] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Sep 27 09:40:12 2022] POST /identity/v3/services => generated 242 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:40:13.744621 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e72380-1210-4207-82f3-74015bfcc370 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:13.745195 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e72380-1210-4207-82f3-74015bfcc370 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:13.745195 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e72380-1210-4207-82f3-74015bfcc370 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:13.746913 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 338/678] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:40:13.752843 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa354c0-1d67-4836-9068-3d6222328e30 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:13.753374 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa354c0-1d67-4836-9068-3d6222328e30 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:13.753374 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa354c0-1d67-4836-9068-3d6222328e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:13.774937 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-1aa354c0-1d67-4836-9068-3d6222328e30 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:13.776324 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-1aa354c0-1d67-4836-9068-3d6222328e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:13.865467 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 341/679] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:13 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 09:40:13.918308 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067fbcc-1c36-46d8-a14a-855709868797 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:13.918677 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067fbcc-1c36-46d8-a14a-855709868797 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:13.918899 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067fbcc-1c36-46d8-a14a-855709868797 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:13.920699 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 339/680] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:40:13.928589 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70eb258-b137-4faf-94a0-2382ee57ad18 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:13.928917 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70eb258-b137-4faf-94a0-2382ee57ad18 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:13.929138 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70eb258-b137-4faf-94a0-2382ee57ad18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:13.948955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-d70eb258-b137-4faf-94a0-2382ee57ad18 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:13.950168 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-d70eb258-b137-4faf-94a0-2382ee57ad18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:14.026467 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 342/681] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:13 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 09:40:14.196924 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067fbcc-1c36-46d8-a14a-855709868797 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:14.314042 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067fbcc-1c36-46d8-a14a-855709868797 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:14.332969 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:14.351738 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70eb258-b137-4faf-94a0-2382ee57ad18 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:14.356332 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38b3bc-d28d-404c-8acd-1636bcc9c812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:14.357386 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38b3bc-d28d-404c-8acd-1636bcc9c812 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:14.357858 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38b3bc-d28d-404c-8acd-1636bcc9c812 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:14.358296 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38b3bc-d28d-404c-8acd-1636bcc9c812 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:14.380549 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f38b3bc-d28d-404c-8acd-1636bcc9c812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:40:14.384073 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:14.391565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-9f38b3bc-d28d-404c-8acd-1636bcc9c812 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:40:14.391565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:14.391565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:14.391565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:14.391565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:14.391565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:14.391565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:14.391565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:14.391565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:14.391565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:14.391565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:14.391565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:14.391565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:40:14.391565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:40:14.391565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:40:14.391565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:40:14.392602 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:40:14.392602 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:40:14.392602 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:40:14.392602 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:40:14.392602 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:14.392602 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:14.392602 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:14.392602 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:14.392602 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:14.392602 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:14.392602 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:14.392602 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:14.392602 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:14.392602 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:14.392602 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:14.392602 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:14.393879 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:14.393879 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:14.393879 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:14.393879 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:14.393879 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:40:14.393879 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:40:14.393879 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:40:14.393879 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:40:14.393879 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:40:14.393879 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:40:14.393879 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:40:14.393879 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:14.393879 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 340/682] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 27 09:40:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:14.402222 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38b3bc-d28d-404c-8acd-1636bcc9c812 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:14.512755 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70eb258-b137-4faf-94a0-2382ee57ad18 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:14.529935 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38b3bc-d28d-404c-8acd-1636bcc9c812 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:14.563783 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f534bc3-a52d-491a-94f7-c5ebfde1d026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:14.564843 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f534bc3-a52d-491a-94f7-c5ebfde1d026 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:14.565320 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f534bc3-a52d-491a-94f7-c5ebfde1d026 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:14.565848 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f534bc3-a52d-491a-94f7-c5ebfde1d026 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:14.566752 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f534bc3-a52d-491a-94f7-c5ebfde1d026 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:14.568517 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f534bc3-a52d-491a-94f7-c5ebfde1d026 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:14.575330 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d95e0-7d95-4008-bb8a-00caf1afa580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:14.575959 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d95e0-7d95-4008-bb8a-00caf1afa580 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:14.576239 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d95e0-7d95-4008-bb8a-00caf1afa580 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:14.576512 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d95e0-7d95-4008-bb8a-00caf1afa580 None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:14.577190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d95e0-7d95-4008-bb8a-00caf1afa580 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:14.577493 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d95e0-7d95-4008-bb8a-00caf1afa580 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:14.578910 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d95e0-7d95-4008-bb8a-00caf1afa580 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:14.592431 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-7f534bc3-a52d-491a-94f7-c5ebfde1d026 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 09:40:14.592431 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:14.592431 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 09:40:14.592431 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 09:40:14.592431 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 09:40:14.592431 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 09:40:14.592431 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 09:40:14.592431 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:14.592431 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 09:40:14.592431 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:14.592431 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 09:40:14.592431 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:14.592431 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:14.592431 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:14.592431 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:14.592431 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:14.592431 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:14.593583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:14.593583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:14.593583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:14.593583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:14.593583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:14.593583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:14.593583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 09:40:14.593583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 09:40:14.593583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 09:40:14.593583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 09:40:14.593583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:14.593583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:14.593583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:14.593583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:14.593583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:14.593583 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:14.594430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:14.594430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:14.594430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:14.594430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:14.594430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:14.594430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:14.594430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:14.594430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:14.594430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:14.594430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:14.594430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 09:40:14.594430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:14.594430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 09:40:14.594430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:14.595218 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 341/683] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:40:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:40:14.595291 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 343/684] 10.222.0.49 () {56 vars in 1129 bytes} [Tue Sep 27 09:40:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 09:40:14.596585 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d95e0-7d95-4008-bb8a-00caf1afa580 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:14.600823 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f534bc3-a52d-491a-94f7-c5ebfde1d026 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:14.643649 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:14.716850 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:14.720120 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d95e0-7d95-4008-bb8a-00caf1afa580 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:14.725889 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f534bc3-a52d-491a-94f7-c5ebfde1d026 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:14.762066 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2cd3b-6e15-4373-a0dc-39faa9fd132f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:14.763514 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2cd3b-6e15-4373-a0dc-39faa9fd132f None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:14.763978 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2cd3b-6e15-4373-a0dc-39faa9fd132f None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:14.764560 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2cd3b-6e15-4373-a0dc-39faa9fd132f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:14.773540 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405f9b8-119d-423d-b38a-f99f5b57f8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:14.774719 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405f9b8-119d-423d-b38a-f99f5b57f8f7 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:14.775598 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405f9b8-119d-423d-b38a-f99f5b57f8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:14.775853 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405f9b8-119d-423d-b38a-f99f5b57f8f7 None admin] PATH_INFO: `/v3/services` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:14.777083 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405f9b8-119d-423d-b38a-f99f5b57f8f7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:14.777686 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405f9b8-119d-423d-b38a-f99f5b57f8f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:14.787460 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405f9b8-119d-423d-b38a-f99f5b57f8f7 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:14.787460 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 344/685] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Sep 27 09:40:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:14.794123 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2cd3b-6e15-4373-a0dc-39faa9fd132f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:14.795992 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2cd3b-6e15-4373-a0dc-39faa9fd132f None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:14.796285 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405f9b8-119d-423d-b38a-f99f5b57f8f7 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:14.816101 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-e9b2cd3b-6e15-4373-a0dc-39faa9fd132f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:40:14.816101 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:14.816101 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:14.816101 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:14.816101 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:14.816101 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:14.816101 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:14.816101 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:14.816101 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:14.816101 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:14.816101 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:14.816101 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:14.816101 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:40:14.816101 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:40:14.816101 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:40:14.816101 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:40:14.817149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:14.817149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:14.817149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:14.817149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:14.817149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:14.817149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:14.817149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:14.817149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:14.817149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:14.817149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:14.817149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:14.817149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:14.817149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:14.817149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:14.817149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:14.817149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:14.817149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:40:14.818171 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:40:14.818171 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:40:14.818171 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:14.821830 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 342/686] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:40:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:14.823514 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2cd3b-6e15-4373-a0dc-39faa9fd132f None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:14.947832 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405f9b8-119d-423d-b38a-f99f5b57f8f7 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:14.962007 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:14.976473 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2cd3b-6e15-4373-a0dc-39faa9fd132f None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:14.997607 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d63ef1-0c49-45e2-aea1-e7ff109affc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:14.998638 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d63ef1-0c49-45e2-aea1-e7ff109affc0 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:14.999158 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d63ef1-0c49-45e2-aea1-e7ff109affc0 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:14.999651 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d63ef1-0c49-45e2-aea1-e7ff109affc0 None admin] PATH_INFO: `/v3/services` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:15.000505 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d63ef1-0c49-45e2-aea1-e7ff109affc0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:15.001032 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d63ef1-0c49-45e2-aea1-e7ff109affc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:15.002924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d63ef1-0c49-45e2-aea1-e7ff109affc0 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:15.015347 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 345/687] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Sep 27 09:40:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:40:15.018463 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d63ef1-0c49-45e2-aea1-e7ff109affc0 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:15.018945 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feed678-d4ee-49d5-b9f8-98ceb7a580ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:15.019685 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feed678-d4ee-49d5-b9f8-98ceb7a580ac None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:15.019967 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feed678-d4ee-49d5-b9f8-98ceb7a580ac None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:15.020239 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feed678-d4ee-49d5-b9f8-98ceb7a580ac None admin] PATH_INFO: `/v3/domains` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:15.021102 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feed678-d4ee-49d5-b9f8-98ceb7a580ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:15.021413 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feed678-d4ee-49d5-b9f8-98ceb7a580ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:15.023205 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feed678-d4ee-49d5-b9f8-98ceb7a580ac None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:15.041995 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 343/688] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:40:15.043091 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feed678-d4ee-49d5-b9f8-98ceb7a580ac None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:15.053362 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:15.146784 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d63ef1-0c49-45e2-aea1-e7ff109affc0 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:15.162532 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feed678-d4ee-49d5-b9f8-98ceb7a580ac None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:15.188270 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab17db-c515-441c-a5a3-3f83dbb06960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:15.189251 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab17db-c515-441c-a5a3-3f83dbb06960 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:15.189709 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab17db-c515-441c-a5a3-3f83dbb06960 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:15.190166 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab17db-c515-441c-a5a3-3f83dbb06960 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:15.191173 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab17db-c515-441c-a5a3-3f83dbb06960 None admin] RBAC: Adding query filter params (interface=public, service_id=1429c02e5b1e41de90cc01e1fd009931, region_id=RegionOne) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:15.191736 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab17db-c515-441c-a5a3-3f83dbb06960 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:15.193434 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab17db-c515-441c-a5a3-3f83dbb06960 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:15.207506 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636bea3-58a1-4cac-b062-2effcc6962bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:15.207506 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636bea3-58a1-4cac-b062-2effcc6962bc None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:15.207506 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636bea3-58a1-4cac-b062-2effcc6962bc None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:15.207506 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636bea3-58a1-4cac-b062-2effcc6962bc None admin] PATH_INFO: `/v3/users/nova` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:15.208177 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 346/689] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Sep 27 09:40:15 2022] GET /identity/v3/endpoints?service_id=1429c02e5b1e41de90cc01e1fd009931&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:40:15.209397 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab17db-c515-441c-a5a3-3f83dbb06960 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:15.212755 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636bea3-58a1-4cac-b062-2effcc6962bc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:15.214811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636bea3-58a1-4cac-b062-2effcc6962bc None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:15.229242 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-e636bea3-58a1-4cac-b062-2effcc6962bc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 09:40:15.229242 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:15.229242 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:15.229242 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:15.229242 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:15.229242 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:15.229242 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:15.229242 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:15.229242 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:15.229242 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:15.229242 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:15.229242 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:15.229242 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 09:40:15.229242 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 09:40:15.229242 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 09:40:15.229242 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 09:40:15.231103 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:15.231103 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:15.231103 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 09:40:15.231103 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:40:15.231103 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 09:40:15.231103 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:40:15.231103 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:15.231103 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:15.231103 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:15.231103 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:15.231103 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:15.231103 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:15.231103 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:15.231103 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:15.231103 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:15.231103 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:15.231103 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:15.231103 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:15.232950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:15.232950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:15.232950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 09:40:15.232950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 09:40:15.232950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 09:40:15.232950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 09:40:15.232950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 09:40:15.232950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 09:40:15.232950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 09:40:15.232950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:15.234879 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 344/690] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Sep 27 09:40:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 09:40:15.236986 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636bea3-58a1-4cac-b062-2effcc6962bc None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:15.251407 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:15.355491 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636bea3-58a1-4cac-b062-2effcc6962bc None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:15.385465 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:15.395310 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b1d13-4b08-41ea-8751-0e93f28f3955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:15.396083 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b1d13-4b08-41ea-8751-0e93f28f3955 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:15.397140 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b1d13-4b08-41ea-8751-0e93f28f3955 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:15.397479 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b1d13-4b08-41ea-8751-0e93f28f3955 None admin] PATH_INFO: `/v3/users` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:15.398265 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b1d13-4b08-41ea-8751-0e93f28f3955 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:15.398644 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b1d13-4b08-41ea-8751-0e93f28f3955 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:15.400809 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b1d13-4b08-41ea-8751-0e93f28f3955 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:15.422152 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab17db-c515-441c-a5a3-3f83dbb06960 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:15.428753 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 345/691] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Sep 27 09:40:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:40:15.429797 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b1d13-4b08-41ea-8751-0e93f28f3955 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:15.492342 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac98304-a4b4-4317-bde0-b483fcd07429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:15.493713 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac98304-a4b4-4317-bde0-b483fcd07429 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:15.494400 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac98304-a4b4-4317-bde0-b483fcd07429 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:15.495097 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac98304-a4b4-4317-bde0-b483fcd07429 None admin] PATH_INFO: `/v3/services` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:15.496494 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac98304-a4b4-4317-bde0-b483fcd07429 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:15.502310 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac98304-a4b4-4317-bde0-b483fcd07429 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:15.509096 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 347/692] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Sep 27 09:40:15 2022] GET /identity/v3/services => generated 1002 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 09:40:15.509704 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:15.552234 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b1d13-4b08-41ea-8751-0e93f28f3955 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:15.608807 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcdec8-3d39-417f-86f6-e1b6ec4c2437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:15.609397 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcdec8-3d39-417f-86f6-e1b6ec4c2437 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:15.609681 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcdec8-3d39-417f-86f6-e1b6ec4c2437 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:15.609957 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcdec8-3d39-417f-86f6-e1b6ec4c2437 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:15.624126 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbcdec8-3d39-417f-86f6-e1b6ec4c2437 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:15.625759 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbcdec8-3d39-417f-86f6-e1b6ec4c2437 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:15.644324 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-8fbcdec8-3d39-417f-86f6-e1b6ec4c2437 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:40:15.644324 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:15.644324 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:15.644324 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:15.644324 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:15.644324 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:15.644324 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:15.644324 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:15.644324 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:15.644324 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:15.644324 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:15.644324 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:15.644324 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:40:15.644324 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:40:15.644324 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:40:15.644324 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:40:15.645409 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:15.645409 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:15.645409 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:15.645409 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:15.645409 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:15.645409 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:15.645409 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:15.645409 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:15.645409 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:15.645409 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:15.645409 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:15.645409 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:15.645409 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:15.645409 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:15.645409 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:15.645409 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:15.645409 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:40:15.647215 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:40:15.647215 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:40:15.647215 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:15.647215 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 346/693] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 09:40:15.655975 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac98304-a4b4-4317-bde0-b483fcd07429 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:15.782367 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac98304-a4b4-4317-bde0-b483fcd07429 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:15.828392 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bda2df-77c9-49ac-af2e-ba1476df94fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:15.829445 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bda2df-77c9-49ac-af2e-ba1476df94fa None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:15.829944 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bda2df-77c9-49ac-af2e-ba1476df94fa None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:15.830408 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bda2df-77c9-49ac-af2e-ba1476df94fa None admin] PATH_INFO: `/v3/domains` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:15.831321 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bda2df-77c9-49ac-af2e-ba1476df94fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:15.831832 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bda2df-77c9-49ac-af2e-ba1476df94fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:15.833812 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bda2df-77c9-49ac-af2e-ba1476df94fa None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:15.855567 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 348/694] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:15.861322 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcdec8-3d39-417f-86f6-e1b6ec4c2437 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:16.046458 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcdec8-3d39-417f-86f6-e1b6ec4c2437 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:16.085999 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:16.113723 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3346b-159f-4b99-b82c-b33f72097a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:16.115073 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3346b-159f-4b99-b82c-b33f72097a6c None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:16.115631 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3346b-159f-4b99-b82c-b33f72097a6c None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:16.116115 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3346b-159f-4b99-b82c-b33f72097a6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:16.129489 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3346b-159f-4b99-b82c-b33f72097a6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:16.132329 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3346b-159f-4b99-b82c-b33f72097a6c None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:16.155068 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-dcc3346b-159f-4b99-b82c-b33f72097a6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:40:16.155068 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:16.155068 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:16.155068 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:16.155068 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:16.155068 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:16.155068 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:16.155068 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:16.155068 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:16.155068 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:16.155068 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:16.155068 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:16.155068 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 09:40:16.155068 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 09:40:16.155068 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 09:40:16.156044 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 09:40:16.156044 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:16.156044 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:16.156044 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:16.156044 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:16.156044 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:16.156044 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:16.156044 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:16.156044 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:16.156044 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:16.156044 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:16.156044 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:16.156044 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:16.156044 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:16.156044 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:16.156044 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:16.156044 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:16.156930 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 09:40:16.156930 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 09:40:16.156930 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 09:40:16.156930 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 09:40:16.156930 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 09:40:16.156930 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 09:40:16.156930 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:40:16.156930 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:16.157841 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 347/695] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:40:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 09:40:16.167620 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bda2df-77c9-49ac-af2e-ba1476df94fa None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:16.188466 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:16.195104 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16934b4f-f795-41e6-966a-b04785b575af None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:16.195738 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16934b4f-f795-41e6-966a-b04785b575af None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:16.196562 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16934b4f-f795-41e6-966a-b04785b575af None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:16.199569 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 348/696] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:40:16.209350 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d30e10-6346-436f-885d-b628337640be None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:16.210169 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d30e10-6346-436f-885d-b628337640be None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:16.210949 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d30e10-6346-436f-885d-b628337640be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:16.235076 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-57d30e10-6346-436f-885d-b628337640be None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:16.236743 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-57d30e10-6346-436f-885d-b628337640be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:16.320743 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 349/697] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:16 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 09:40:16.344761 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ed095-b5a1-4ce9-9d63-6ac2acfea8f3 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:16.345061 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ed095-b5a1-4ce9-9d63-6ac2acfea8f3 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:16.345395 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ed095-b5a1-4ce9-9d63-6ac2acfea8f3 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:16.346633 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 350/698] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:40:16.358026 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64416b-7b0b-40f9-bd95-c546f4c8de33 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:16.358951 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64416b-7b0b-40f9-bd95-c546f4c8de33 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:16.359935 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64416b-7b0b-40f9-bd95-c546f4c8de33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:16.365459 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bda2df-77c9-49ac-af2e-ba1476df94fa None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:16.392644 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-5f64416b-7b0b-40f9-bd95-c546f4c8de33 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:16.395987 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-5f64416b-7b0b-40f9-bd95-c546f4c8de33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:16.435170 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bde6b-ffc4-4439-9662-578209183d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:16.437026 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bde6b-ffc4-4439-9662-578209183d2e None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:16.437732 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bde6b-ffc4-4439-9662-578209183d2e None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:16.438711 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bde6b-ffc4-4439-9662-578209183d2e None admin] PATH_INFO: `/v3/projects` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:16.441042 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bde6b-ffc4-4439-9662-578209183d2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:16.442123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bde6b-ffc4-4439-9662-578209183d2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:16.446308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bde6b-ffc4-4439-9662-578209183d2e None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:16.471854 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 349/699] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 27 09:40:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:16.479884 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bde6b-ffc4-4439-9662-578209183d2e None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:16.522882 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 351/700] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:16 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 09:40:16.574272 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:16.642174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bde6b-ffc4-4439-9662-578209183d2e None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:16.653683 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64416b-7b0b-40f9-bd95-c546f4c8de33 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:16.706658 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e93f8-109e-49a2-987c-e1f3a7b87d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:16.707514 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e93f8-109e-49a2-987c-e1f3a7b87d60 None admin] REQUEST_METHOD: `PUT` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:16.707892 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e93f8-109e-49a2-987c-e1f3a7b87d60 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:16.708337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e93f8-109e-49a2-987c-e1f3a7b87d60 None admin] PATH_INFO: `/v3/projects/dbe5c492b05e40448942bb2500c185ee/users/bda026ed208d4736938da05121a06f4e/roles/7cc7d3c85c794033b590117321e97ccf` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:16.710603 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e93f8-109e-49a2-987c-e1f3a7b87d60 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbe5c492b05e40448942bb2500c185ee, user_id=bda026ed208d4736938da05121a06f4e, role_id=7cc7d3c85c794033b590117321e97ccf)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:16.712236 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e93f8-109e-49a2-987c-e1f3a7b87d60 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:16.721535 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:16.733460 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 350/701] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 27 09:40:16 2022] PUT /identity/v3/projects/dbe5c492b05e40448942bb2500c185ee/users/bda026ed208d4736938da05121a06f4e/roles/7cc7d3c85c794033b590117321e97ccf => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 09:40:16.842521 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64416b-7b0b-40f9-bd95-c546f4c8de33 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:16.905489 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d48f3-7dfd-43e2-83d3-bb479a47e044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:16.906414 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d48f3-7dfd-43e2-83d3-bb479a47e044 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:16.906926 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d48f3-7dfd-43e2-83d3-bb479a47e044 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:16.907394 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d48f3-7dfd-43e2-83d3-bb479a47e044 None admin] PATH_INFO: `/v3/services/image` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:16.908422 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d48f3-7dfd-43e2-83d3-bb479a47e044 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:16.911094 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d48f3-7dfd-43e2-83d3-bb479a47e044 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:16.928541 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-6e8d48f3-7dfd-43e2-83d3-bb479a47e044 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 09:40:16.928541 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:16.928541 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 09:40:16.928541 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 09:40:16.928541 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 09:40:16.928541 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 09:40:16.928541 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 09:40:16.928541 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:16.928541 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 09:40:16.928541 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:16.928541 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 09:40:16.928541 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:16.928541 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:16.928541 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:16.928541 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:16.928541 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:16.928541 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:16.929619 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:16.929619 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:16.929619 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:16.929619 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:16.929619 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:16.929619 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:16.929619 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 09:40:16.929619 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 09:40:16.929619 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 09:40:16.929619 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 09:40:16.929619 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:16.929619 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:16.929619 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:16.929619 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:16.929619 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:16.929619 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:16.930448 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:16.930448 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:16.930448 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:16.930448 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:16.930448 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:16.930448 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:16.930448 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:16.930448 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:16.930448 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:16.930448 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:16.930448 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 09:40:16.930448 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:16.930448 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 09:40:16.930448 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:16.931230 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 352/702] 10.222.0.49 () {56 vars in 1105 bytes} [Tue Sep 27 09:40:16 2022] GET /identity/v3/services/image => generated 86 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:16.936986 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e93f8-109e-49a2-987c-e1f3a7b87d60 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:17.053459 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e93f8-109e-49a2-987c-e1f3a7b87d60 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:17.084538 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:17.091569 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9aa5c-7ce7-4848-a457-870321623d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:17.092217 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9aa5c-7ce7-4848-a457-870321623d8b None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:17.092493 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9aa5c-7ce7-4848-a457-870321623d8b None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:17.092763 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9aa5c-7ce7-4848-a457-870321623d8b None admin] PATH_INFO: `/v3/services` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:17.093507 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9aa5c-7ce7-4848-a457-870321623d8b None admin] RBAC: Adding query filter params (name=image) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:17.094020 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9aa5c-7ce7-4848-a457-870321623d8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:17.095793 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9aa5c-7ce7-4848-a457-870321623d8b None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:17.101533 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 351/703] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:40:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:17.107670 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d48f3-7dfd-43e2-83d3-bb479a47e044 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:17.109622 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9aa5c-7ce7-4848-a457-870321623d8b None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:17.264519 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d48f3-7dfd-43e2-83d3-bb479a47e044 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:17.270026 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:17.310490 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9aa5c-7ce7-4848-a457-870321623d8b None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:17.333816 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac601b54-fa50-4a73-8a42-19dc8ac505a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:17.335129 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac601b54-fa50-4a73-8a42-19dc8ac505a6 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:17.335732 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac601b54-fa50-4a73-8a42-19dc8ac505a6 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:17.336439 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac601b54-fa50-4a73-8a42-19dc8ac505a6 None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:17.337738 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac601b54-fa50-4a73-8a42-19dc8ac505a6 None admin] RBAC: Adding query filter params (type=image) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:17.338368 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac601b54-fa50-4a73-8a42-19dc8ac505a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:17.341305 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac601b54-fa50-4a73-8a42-19dc8ac505a6 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:17.357567 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7c360-6e88-446b-b8f3-52da86d70f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:17.358277 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7c360-6e88-446b-b8f3-52da86d70f9c None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:17.358559 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7c360-6e88-446b-b8f3-52da86d70f9c None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:17.358854 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7c360-6e88-446b-b8f3-52da86d70f9c None admin] PATH_INFO: `/v3/services/network` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:17.359290 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 353/704] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:40:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:17.359580 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7c360-6e88-446b-b8f3-52da86d70f9c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:17.361127 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7c360-6e88-446b-b8f3-52da86d70f9c None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:17.361827 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac601b54-fa50-4a73-8a42-19dc8ac505a6 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:17.372487 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-4be7c360-6e88-446b-b8f3-52da86d70f9c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 09:40:17.372487 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:17.372487 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 09:40:17.372487 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 09:40:17.372487 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 09:40:17.372487 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 09:40:17.372487 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 09:40:17.372487 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:17.372487 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 09:40:17.372487 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:17.372487 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 09:40:17.372487 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:17.372487 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:17.372487 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:17.372487 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:17.372487 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:17.372487 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:17.373542 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:17.373542 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:17.373542 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:17.373542 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:17.373542 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:17.373542 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:17.373542 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 09:40:17.373542 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 09:40:17.373542 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 09:40:17.373542 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 09:40:17.373542 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:17.373542 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:17.373542 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:17.373542 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:17.373542 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:17.373542 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:17.374357 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:17.374357 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:17.374357 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:17.374357 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:17.374357 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:17.374357 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:17.374357 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:17.374357 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:17.374357 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:17.374357 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:17.374357 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 09:40:17.374357 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:17.374357 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 09:40:17.374357 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:17.374357 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 352/705] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:40:17 2022] GET /identity/v3/services/network => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:17.382452 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7c360-6e88-446b-b8f3-52da86d70f9c None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:17.447096 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:17.507354 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7c360-6e88-446b-b8f3-52da86d70f9c None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:17.549422 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fa7f9-9cd0-46d1-9f8a-5c39dadac55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:17.550234 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fa7f9-9cd0-46d1-9f8a-5c39dadac55c None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:17.550513 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fa7f9-9cd0-46d1-9f8a-5c39dadac55c None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:17.550816 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fa7f9-9cd0-46d1-9f8a-5c39dadac55c None admin] PATH_INFO: `/v3/services` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:17.551478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076fa7f9-9cd0-46d1-9f8a-5c39dadac55c None admin] RBAC: Adding query filter params (name=network) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:17.551912 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076fa7f9-9cd0-46d1-9f8a-5c39dadac55c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:17.553540 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076fa7f9-9cd0-46d1-9f8a-5c39dadac55c None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:17.560629 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 353/706] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Sep 27 09:40:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:40:17.564789 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac601b54-fa50-4a73-8a42-19dc8ac505a6 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:17.572378 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fa7f9-9cd0-46d1-9f8a-5c39dadac55c None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:17.632981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e849c-a0e3-4168-9013-0f84c2d25880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:17.633678 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e849c-a0e3-4168-9013-0f84c2d25880 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:17.633961 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e849c-a0e3-4168-9013-0f84c2d25880 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:17.634242 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e849c-a0e3-4168-9013-0f84c2d25880 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:17.635468 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e849c-a0e3-4168-9013-0f84c2d25880 None admin] RBAC: Adding query filter params (interface=public, service_id=78c6eace907448e6b99479f245aeed71, region_id=RegionOne) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:17.635468 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e849c-a0e3-4168-9013-0f84c2d25880 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:17.636954 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e849c-a0e3-4168-9013-0f84c2d25880 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:17.647002 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 354/707] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Sep 27 09:40:17 2022] GET /identity/v3/endpoints?service_id=78c6eace907448e6b99479f245aeed71&interface=public®ion_id=RegionOne => generated 194 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:40:17.655418 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e849c-a0e3-4168-9013-0f84c2d25880 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:17.707388 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:17.765617 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fa7f9-9cd0-46d1-9f8a-5c39dadac55c None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:17.793398 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:17.811804 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455e813-76a5-4453-a538-c36d587af8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:17.812787 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455e813-76a5-4453-a538-c36d587af8bd None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:17.813291 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455e813-76a5-4453-a538-c36d587af8bd None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:17.813805 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455e813-76a5-4453-a538-c36d587af8bd None admin] PATH_INFO: `/v3/services` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:17.814822 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455e813-76a5-4453-a538-c36d587af8bd None admin] RBAC: Adding query filter params (type=network) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:17.815343 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455e813-76a5-4453-a538-c36d587af8bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:17.816956 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455e813-76a5-4453-a538-c36d587af8bd None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:17.824570 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 354/708] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Sep 27 09:40:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:17.839592 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e849c-a0e3-4168-9013-0f84c2d25880 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:17.840546 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455e813-76a5-4453-a538-c36d587af8bd None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:17.892988 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d30d90-ce4d-44fc-af4e-8451b601a555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:17.893896 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d30d90-ce4d-44fc-af4e-8451b601a555 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:17.894311 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d30d90-ce4d-44fc-af4e-8451b601a555 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:17.894711 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d30d90-ce4d-44fc-af4e-8451b601a555 None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:17.895770 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d30d90-ce4d-44fc-af4e-8451b601a555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:17.897952 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d30d90-ce4d-44fc-af4e-8451b601a555 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:17.908184 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 355/709] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Sep 27 09:40:17 2022] GET /identity/v3/services => generated 1002 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 09:40:18.038337 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455e813-76a5-4453-a538-c36d587af8bd None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:18.105925 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d0cdd-751b-4b30-8d3b-37e6e14bf1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:18.106858 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d0cdd-751b-4b30-8d3b-37e6e14bf1b9 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:18.107293 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d0cdd-751b-4b30-8d3b-37e6e14bf1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:18.107731 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d0cdd-751b-4b30-8d3b-37e6e14bf1b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:18.108914 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d0cdd-751b-4b30-8d3b-37e6e14bf1b9 None admin] RBAC: Adding query filter params (interface=public, service_id=a3c2b7c15ad64a05819be0c17b6f9b1f, region_id=RegionOne) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:18.109398 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d0cdd-751b-4b30-8d3b-37e6e14bf1b9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:18.111794 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d0cdd-751b-4b30-8d3b-37e6e14bf1b9 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:18.122445 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 355/710] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Sep 27 09:40:17 2022] GET /identity/v3/endpoints?service_id=a3c2b7c15ad64a05819be0c17b6f9b1f&interface=public®ion_id=RegionOne => generated 194 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:18.131728 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d30d90-ce4d-44fc-af4e-8451b601a555 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:18.314496 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:18.327754 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d30d90-ce4d-44fc-af4e-8451b601a555 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:18.388892 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248937a-b087-43ce-8cb9-8bcbcf157c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:18.389866 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248937a-b087-43ce-8cb9-8bcbcf157c93 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:18.390348 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248937a-b087-43ce-8cb9-8bcbcf157c93 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:18.390955 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248937a-b087-43ce-8cb9-8bcbcf157c93 None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:18.391785 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248937a-b087-43ce-8cb9-8bcbcf157c93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:18.393428 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248937a-b087-43ce-8cb9-8bcbcf157c93 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:18.400842 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 356/711] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Sep 27 09:40:18 2022] GET /identity/v3/services => generated 1002 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 09:40:18.597519 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257ec1b-47de-4a0e-92e4-acf85052901a None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:18.598271 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257ec1b-47de-4a0e-92e4-acf85052901a None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:18.598888 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257ec1b-47de-4a0e-92e4-acf85052901a None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:18.601056 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 356/712] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:40:18.607681 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd14db0-effe-4916-9fa7-c9397901e570 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:18.608335 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd14db0-effe-4916-9fa7-c9397901e570 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:18.608840 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd14db0-effe-4916-9fa7-c9397901e570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:18.631084 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-1fd14db0-effe-4916-9fa7-c9397901e570 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:18.632900 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-1fd14db0-effe-4916-9fa7-c9397901e570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:18.723015 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 357/713] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:18 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 09:40:19.053219 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257ec1b-47de-4a0e-92e4-acf85052901a None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:19.119764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:19.216730 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257ec1b-47de-4a0e-92e4-acf85052901a None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:19.296275 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41076687-04c7-4b13-ad27-37044272fea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:19.297402 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41076687-04c7-4b13-ad27-37044272fea2 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:19.297891 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41076687-04c7-4b13-ad27-37044272fea2 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:19.298359 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41076687-04c7-4b13-ad27-37044272fea2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:19.299479 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41076687-04c7-4b13-ad27-37044272fea2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:19.303135 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41076687-04c7-4b13-ad27-37044272fea2 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:19.321548 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-41076687-04c7-4b13-ad27-37044272fea2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 09:40:19.321548 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:19.321548 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 09:40:19.321548 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 09:40:19.321548 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 09:40:19.321548 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 09:40:19.321548 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 09:40:19.321548 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:19.321548 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 09:40:19.321548 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:19.321548 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 09:40:19.321548 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:19.321548 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:19.321548 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:19.321548 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:19.321548 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:19.321548 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:19.322606 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:19.322606 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:19.322606 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:19.322606 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:19.322606 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:19.322606 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:19.322606 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 09:40:19.322606 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 09:40:19.322606 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 09:40:19.322606 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 09:40:19.322606 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:19.322606 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:19.322606 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:19.322606 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:19.322606 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:19.322606 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:19.323486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:19.323486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:19.323486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:19.323486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:19.323486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:19.323486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:19.323486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:19.323486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:19.323486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:19.323486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:19.323486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 09:40:19.323486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:19.323486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 09:40:19.323486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:19.324918 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 357/714] 10.222.0.49 () {56 vars in 1129 bytes} [Tue Sep 27 09:40:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 09:40:19.332353 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd14db0-effe-4916-9fa7-c9397901e570 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:19.446992 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:19.458494 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd14db0-effe-4916-9fa7-c9397901e570 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:19.501670 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3049c7f-b8f0-40ec-97eb-c38959e227ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:19.502321 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3049c7f-b8f0-40ec-97eb-c38959e227ae None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:19.502597 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3049c7f-b8f0-40ec-97eb-c38959e227ae None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:19.502912 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3049c7f-b8f0-40ec-97eb-c38959e227ae None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:19.503565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3049c7f-b8f0-40ec-97eb-c38959e227ae None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:19.503865 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3049c7f-b8f0-40ec-97eb-c38959e227ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:19.505427 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3049c7f-b8f0-40ec-97eb-c38959e227ae None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:19.511716 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 358/715] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Sep 27 09:40:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:19.517874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41076687-04c7-4b13-ad27-37044272fea2 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:19.790588 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41076687-04c7-4b13-ad27-37044272fea2 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:19.807047 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:19.831790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3b951-c3e6-4f5e-a262-4a6abe686147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:19.832472 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3b951-c3e6-4f5e-a262-4a6abe686147 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:19.832744 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3b951-c3e6-4f5e-a262-4a6abe686147 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:19.833005 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3b951-c3e6-4f5e-a262-4a6abe686147 None admin] PATH_INFO: `/v3/services` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:19.833846 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3b951-c3e6-4f5e-a262-4a6abe686147 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:19.834143 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3b951-c3e6-4f5e-a262-4a6abe686147 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:19.835709 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3b951-c3e6-4f5e-a262-4a6abe686147 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:19.843905 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 358/716] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Sep 27 09:40:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:19.849654 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3049c7f-b8f0-40ec-97eb-c38959e227ae None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:19.968556 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3049c7f-b8f0-40ec-97eb-c38959e227ae None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:20.008996 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb90392-77f3-4a6e-b9b1-27839387cb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:20.009621 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb90392-77f3-4a6e-b9b1-27839387cb47 None admin] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:20.017251 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb90392-77f3-4a6e-b9b1-27839387cb47 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:20.017251 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb90392-77f3-4a6e-b9b1-27839387cb47 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:20.017251 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb90392-77f3-4a6e-b9b1-27839387cb47 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:20.017251 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb90392-77f3-4a6e-b9b1-27839387cb47 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:20.045527 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 359/717] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 27 09:40:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:40:20.107446 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614096d-c2f4-4ddc-9de0-6b6a277a5e71 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:20.108423 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614096d-c2f4-4ddc-9de0-6b6a277a5e71 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:20.108920 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614096d-c2f4-4ddc-9de0-6b6a277a5e71 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:20.110935 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 359/718] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:40:20.117895 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfe936-9ca6-4641-8b8f-822dbab752a8 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:20.118221 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfe936-9ca6-4641-8b8f-822dbab752a8 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:20.118457 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfe936-9ca6-4641-8b8f-822dbab752a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:20.140365 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-a8cfe936-9ca6-4641-8b8f-822dbab752a8 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:20.141725 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-a8cfe936-9ca6-4641-8b8f-822dbab752a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:20.145437 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:20.238168 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 360/719] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:20 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 09:40:20.598898 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614096d-c2f4-4ddc-9de0-6b6a277a5e71 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:20.731178 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614096d-c2f4-4ddc-9de0-6b6a277a5e71 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:20.798255 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61b516-43d3-4597-8d10-60579dbda694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:20.799334 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61b516-43d3-4597-8d10-60579dbda694 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:20.799807 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61b516-43d3-4597-8d10-60579dbda694 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:20.800270 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61b516-43d3-4597-8d10-60579dbda694 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:20.820264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61b516-43d3-4597-8d10-60579dbda694 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:40:20.829685 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-2c61b516-43d3-4597-8d10-60579dbda694 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:40:20.829685 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:20.829685 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:20.829685 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:20.829685 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:20.829685 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:20.829685 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:20.829685 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:20.829685 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:20.829685 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:20.829685 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:20.829685 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:20.829685 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:40:20.829685 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:40:20.829685 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:40:20.829685 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:40:20.830671 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:40:20.830671 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:40:20.830671 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:40:20.830671 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:40:20.830671 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:20.830671 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:20.830671 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:20.830671 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:20.830671 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:20.830671 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:20.830671 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:20.830671 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:20.830671 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:20.830671 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:20.830671 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:20.830671 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:20.831557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:20.831557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:20.831557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:20.831557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:20.831557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:40:20.831557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:40:20.831557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:40:20.831557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:40:20.831557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:40:20.831557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:40:20.831557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:40:20.831557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:20.832189 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 360/720] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 27 09:40:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 09:40:20.839153 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cfe936-9ca6-4641-8b8f-822dbab752a8 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:21.096366 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cfe936-9ca6-4641-8b8f-822dbab752a8 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:21.135976 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce108a-2d63-47c0-ab29-27508f29a2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:21.136998 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce108a-2d63-47c0-ab29-27508f29a2e8 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:21.137503 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce108a-2d63-47c0-ab29-27508f29a2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:21.137991 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce108a-2d63-47c0-ab29-27508f29a2e8 None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:21.138931 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce108a-2d63-47c0-ab29-27508f29a2e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:21.139438 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce108a-2d63-47c0-ab29-27508f29a2e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:21.141069 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce108a-2d63-47c0-ab29-27508f29a2e8 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:21.144165 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:21.151481 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 361/721] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:40:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:21.160484 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61b516-43d3-4597-8d10-60579dbda694 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:21.202203 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:21.311547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61b516-43d3-4597-8d10-60579dbda694 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:21.376307 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531b593-cdef-478c-a68e-ea645c3ea196 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:21.376725 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531b593-cdef-478c-a68e-ea645c3ea196 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:21.377069 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531b593-cdef-478c-a68e-ea645c3ea196 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:21.378931 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc8597-5314-46b1-8529-a35b281cdcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:21.380556 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc8597-5314-46b1-8529-a35b281cdcee None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:21.381395 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc8597-5314-46b1-8529-a35b281cdcee None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:21.382155 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc8597-5314-46b1-8529-a35b281cdcee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:21.384677 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 362/722] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:40:21.388920 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fb686-7ade-4d8b-bf95-7264d888d978 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:21.389358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fb686-7ade-4d8b-bf95-7264d888d978 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:21.389807 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fb686-7ade-4d8b-bf95-7264d888d978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:21.404070 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc8597-5314-46b1-8529-a35b281cdcee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:21.406784 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc8597-5314-46b1-8529-a35b281cdcee None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:21.420910 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-0d6fb686-7ade-4d8b-bf95-7264d888d978 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:21.423690 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-0d6fb686-7ade-4d8b-bf95-7264d888d978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:21.434526 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-b0dc8597-5314-46b1-8529-a35b281cdcee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:40:21.434526 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:21.434526 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:21.434526 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:21.434526 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:21.434526 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:21.434526 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:21.434526 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:21.434526 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:21.434526 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:21.434526 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:21.434526 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:21.434526 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:40:21.434526 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:40:21.434526 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:40:21.434526 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:40:21.436538 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:21.436538 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:21.436538 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:21.436538 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:21.436538 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:21.436538 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:21.436538 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:21.436538 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:21.436538 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:21.436538 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:21.436538 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:21.436538 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:21.436538 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:21.436538 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:21.436538 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:21.436538 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:21.436538 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:40:21.438978 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:40:21.438978 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:40:21.438978 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:21.438978 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 361/723] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:40:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:21.443553 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc8597-5314-46b1-8529-a35b281cdcee None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:21.592614 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 363/724] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:21 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 09:40:21.613084 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:21.637855 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc8597-5314-46b1-8529-a35b281cdcee None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:21.711263 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a9a6c-b6c0-4524-a347-dad88cbd8397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:21.712657 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a9a6c-b6c0-4524-a347-dad88cbd8397 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:21.713310 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a9a6c-b6c0-4524-a347-dad88cbd8397 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:21.713975 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a9a6c-b6c0-4524-a347-dad88cbd8397 None admin] PATH_INFO: `/v3/domains` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:21.715586 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a9a6c-b6c0-4524-a347-dad88cbd8397 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:21.716353 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a9a6c-b6c0-4524-a347-dad88cbd8397 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:21.719197 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a9a6c-b6c0-4524-a347-dad88cbd8397 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:21.744223 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 362/725] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:21.750215 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fb686-7ade-4d8b-bf95-7264d888d978 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:21.894210 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d5750-ce93-4409-92d2-dfa839b01495 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:21.894452 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d5750-ce93-4409-92d2-dfa839b01495 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:21.894784 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d5750-ce93-4409-92d2-dfa839b01495 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:21.896721 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 363/726] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:40:21.902236 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558ef3f-6b90-4e69-b81e-b004ab699465 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:21.902579 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558ef3f-6b90-4e69-b81e-b004ab699465 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:21.902787 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558ef3f-6b90-4e69-b81e-b004ab699465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:21.922872 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-f558ef3f-6b90-4e69-b81e-b004ab699465 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:21.924093 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-f558ef3f-6b90-4e69-b81e-b004ab699465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:21.937169 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fb686-7ade-4d8b-bf95-7264d888d978 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:21.985124 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:21.999861 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0f1bc-a795-4fa3-8090-12af64c92eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:22.000625 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0f1bc-a795-4fa3-8090-12af64c92eb8 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:22.000911 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0f1bc-a795-4fa3-8090-12af64c92eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:22.001238 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0f1bc-a795-4fa3-8090-12af64c92eb8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:22.010245 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0f1bc-a795-4fa3-8090-12af64c92eb8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:22.011956 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0f1bc-a795-4fa3-8090-12af64c92eb8 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:22.024397 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 364/727] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:21 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 09:40:22.028253 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-34e0f1bc-a795-4fa3-8090-12af64c92eb8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 09:40:22.028253 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:22.028253 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:22.028253 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:22.028253 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:22.028253 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:22.028253 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:22.028253 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:22.028253 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:22.028253 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:22.028253 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:22.028253 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:22.028253 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 09:40:22.028253 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 09:40:22.028253 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 09:40:22.028253 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 09:40:22.029950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:22.029950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:22.029950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 09:40:22.029950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:40:22.029950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 09:40:22.029950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:40:22.029950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:22.029950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:22.029950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:22.029950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:22.029950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:22.029950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:22.029950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:22.029950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:22.029950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:22.029950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:22.029950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:22.029950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:22.031578 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:22.031578 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:22.031578 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 09:40:22.031578 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 09:40:22.031578 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 09:40:22.031578 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 09:40:22.031578 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 09:40:22.031578 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 09:40:22.031578 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 09:40:22.031578 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:22.035916 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 364/728] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Sep 27 09:40:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 09:40:22.046813 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558ef3f-6b90-4e69-b81e-b004ab699465 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:22.159769 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:22.175185 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558ef3f-6b90-4e69-b81e-b004ab699465 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:22.218096 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0f1bc-a795-4fa3-8090-12af64c92eb8 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:22.226401 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f17d98-dbf1-4d40-b37c-93a5b82372c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:22.227074 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f17d98-dbf1-4d40-b37c-93a5b82372c6 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:22.227348 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f17d98-dbf1-4d40-b37c-93a5b82372c6 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:22.227624 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f17d98-dbf1-4d40-b37c-93a5b82372c6 None admin] PATH_INFO: `/v3/users` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:22.228571 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f17d98-dbf1-4d40-b37c-93a5b82372c6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:22.228878 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f17d98-dbf1-4d40-b37c-93a5b82372c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:22.230558 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f17d98-dbf1-4d40-b37c-93a5b82372c6 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:22.259028 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 365/729] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Sep 27 09:40:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:22.265534 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f17d98-dbf1-4d40-b37c-93a5b82372c6 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:22.371922 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0f1bc-a795-4fa3-8090-12af64c92eb8 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:22.384275 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f17d98-dbf1-4d40-b37c-93a5b82372c6 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:22.416227 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e6801-3e84-4040-90b0-d55c53f68fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:22.417510 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e6801-3e84-4040-90b0-d55c53f68fc4 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:22.418023 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e6801-3e84-4040-90b0-d55c53f68fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:22.418501 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e6801-3e84-4040-90b0-d55c53f68fc4 None admin] PATH_INFO: `/v3/services/image` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:22.419469 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e6801-3e84-4040-90b0-d55c53f68fc4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:22.421454 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e6801-3e84-4040-90b0-d55c53f68fc4 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:22.426108 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69384c-24a0-4e55-a7f3-a3fb6b1b1b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:22.427097 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69384c-24a0-4e55-a7f3-a3fb6b1b1b6b None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:22.427380 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69384c-24a0-4e55-a7f3-a3fb6b1b1b6b None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:22.427650 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69384c-24a0-4e55-a7f3-a3fb6b1b1b6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:22.431885 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:22.434743 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-a71e6801-3e84-4040-90b0-d55c53f68fc4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 09:40:22.434743 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:22.434743 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 09:40:22.434743 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 09:40:22.434743 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 09:40:22.434743 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 09:40:22.434743 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 09:40:22.434743 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:22.434743 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 09:40:22.434743 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:22.434743 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 09:40:22.434743 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:22.434743 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:22.434743 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:22.434743 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:22.434743 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:22.434743 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:22.435778 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:22.435778 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:22.435778 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:22.435778 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:22.435778 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:22.435778 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:22.435778 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 09:40:22.435778 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 09:40:22.435778 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 09:40:22.435778 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 09:40:22.435778 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:22.435778 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:22.435778 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:22.435778 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:22.435778 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:22.435778 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:22.436622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:22.436622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:22.436622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:22.436622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:22.436622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:22.436622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:22.436622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:22.436622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:22.436622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:22.436622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:22.436622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 09:40:22.436622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:22.436622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 09:40:22.436622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:22.439591 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 365/730] 10.222.0.49 () {56 vars in 1105 bytes} [Tue Sep 27 09:40:22 2022] GET /identity/v3/services/image => generated 86 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:22.449803 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e6801-3e84-4040-90b0-d55c53f68fc4 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:22.560811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:22.575163 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69384c-24a0-4e55-a7f3-a3fb6b1b1b6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:22.577856 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69384c-24a0-4e55-a7f3-a3fb6b1b1b6b None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:22.649056 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e6801-3e84-4040-90b0-d55c53f68fc4 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:22.711425 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602b39a-bc7e-4287-8ff7-4949710a33b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:22.712368 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602b39a-bc7e-4287-8ff7-4949710a33b2 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:22.712806 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602b39a-bc7e-4287-8ff7-4949710a33b2 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:22.713239 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602b39a-bc7e-4287-8ff7-4949710a33b2 None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:22.714422 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602b39a-bc7e-4287-8ff7-4949710a33b2 None admin] RBAC: Adding query filter params (name=image) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:22.715083 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602b39a-bc7e-4287-8ff7-4949710a33b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:22.717395 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602b39a-bc7e-4287-8ff7-4949710a33b2 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:22.731134 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 366/731] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:40:22 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 27 09:40:22.732479 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 366/732] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:40:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:40:22.734241 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69384c-24a0-4e55-a7f3-a3fb6b1b1b6b None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:22.736561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602b39a-bc7e-4287-8ff7-4949710a33b2 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:22.782544 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:22.887360 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69384c-24a0-4e55-a7f3-a3fb6b1b1b6b None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:22.920831 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602b39a-bc7e-4287-8ff7-4949710a33b2 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:22.946000 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d19e6-123e-4104-8dda-3cc639ce3496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:22.946641 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d19e6-123e-4104-8dda-3cc639ce3496 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:22.947117 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d19e6-123e-4104-8dda-3cc639ce3496 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:22.947551 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d19e6-123e-4104-8dda-3cc639ce3496 None admin] PATH_INFO: `/v3/services/network` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:22.948295 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d19e6-123e-4104-8dda-3cc639ce3496 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:22.949691 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d19e6-123e-4104-8dda-3cc639ce3496 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:22.951099 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:22.962950 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-807d19e6-123e-4104-8dda-3cc639ce3496 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 09:40:22.962950 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:22.962950 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 09:40:22.962950 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 09:40:22.962950 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 09:40:22.962950 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 09:40:22.962950 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 09:40:22.962950 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:22.962950 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 09:40:22.962950 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:22.962950 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 09:40:22.962950 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:22.962950 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:22.962950 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:22.962950 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:22.962950 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:22.962950 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:22.964923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:22.964923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:22.964923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:22.964923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:22.964923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:22.964923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:22.964923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 09:40:22.964923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 09:40:22.964923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 09:40:22.964923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 09:40:22.964923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:22.964923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:22.964923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:22.964923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:22.964923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:22.964923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:22.966792 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:22.966792 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:22.966792 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:22.966792 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:22.966792 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:22.966792 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:22.966792 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:22.966792 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:22.966792 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:22.966792 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:22.966792 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 09:40:22.966792 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:22.966792 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 09:40:22.966792 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:22.970007 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 367/733] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:40:22 2022] GET /identity/v3/services/network => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:22.970007 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d19e6-123e-4104-8dda-3cc639ce3496 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:22.982289 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b73a1-1c15-4ee6-bf7e-7d57468f2263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:22.983053 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b73a1-1c15-4ee6-bf7e-7d57468f2263 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:22.983392 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b73a1-1c15-4ee6-bf7e-7d57468f2263 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:22.983728 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b73a1-1c15-4ee6-bf7e-7d57468f2263 None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:22.984432 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b73a1-1c15-4ee6-bf7e-7d57468f2263 None admin] RBAC: Adding query filter params (type=image) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:22.984818 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b73a1-1c15-4ee6-bf7e-7d57468f2263 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:22.986421 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b73a1-1c15-4ee6-bf7e-7d57468f2263 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:22.998485 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 367/734] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:40:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:22.998485 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b73a1-1c15-4ee6-bf7e-7d57468f2263 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:23.155571 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:23.161028 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d19e6-123e-4104-8dda-3cc639ce3496 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:23.170444 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b73a1-1c15-4ee6-bf7e-7d57468f2263 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:23.228975 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c7b9e-c293-4801-aeb7-9211bcc0cadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:23.229967 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c7b9e-c293-4801-aeb7-9211bcc0cadd None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:23.230430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c7b9e-c293-4801-aeb7-9211bcc0cadd None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:23.230965 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c7b9e-c293-4801-aeb7-9211bcc0cadd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:23.236274 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f6dd5-96d5-42af-b637-075e027d040f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:23.237329 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f6dd5-96d5-42af-b637-075e027d040f None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:23.237789 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f6dd5-96d5-42af-b637-075e027d040f None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:23.238273 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f6dd5-96d5-42af-b637-075e027d040f None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:23.239986 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f6dd5-96d5-42af-b637-075e027d040f None admin] RBAC: Adding query filter params (name=network) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:23.240521 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f6dd5-96d5-42af-b637-075e027d040f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:23.243147 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f6dd5-96d5-42af-b637-075e027d040f None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:23.249510 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c7b9e-c293-4801-aeb7-9211bcc0cadd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:23.251149 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c7b9e-c293-4801-aeb7-9211bcc0cadd None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:23.251853 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 368/735] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Sep 27 09:40:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:23.253416 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f6dd5-96d5-42af-b637-075e027d040f None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:23.272426 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-525c7b9e-c293-4801-aeb7-9211bcc0cadd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:40:23.272426 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:23.272426 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:23.272426 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:23.272426 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:23.272426 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:23.272426 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:23.272426 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:23.272426 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:23.272426 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:23.272426 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:23.272426 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:23.272426 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:40:23.272426 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:40:23.272426 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:40:23.272426 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:40:23.273566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:23.273566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:23.273566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:23.273566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:23.273566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:23.273566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:23.273566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:23.273566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:23.273566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:23.273566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:23.273566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:23.273566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:23.273566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:23.273566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:23.273566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:23.273566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:23.273566 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:40:23.274466 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:40:23.274466 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:40:23.274466 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:23.274466 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 368/736] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:40:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:23.276307 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c71bf-0e2f-47ed-88d9-7bc0120b8b79 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:23.276774 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c71bf-0e2f-47ed-88d9-7bc0120b8b79 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:23.277224 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c71bf-0e2f-47ed-88d9-7bc0120b8b79 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:23.279900 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 369/737] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:40:23.281090 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c71bf-0e2f-47ed-88d9-7bc0120b8b79 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:23.333479 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:23.407275 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f6dd5-96d5-42af-b637-075e027d040f None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:23.422067 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c71bf-0e2f-47ed-88d9-7bc0120b8b79 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:23.449634 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f74fd-e3e2-404b-91a4-bae7c919fc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:23.450381 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f74fd-e3e2-404b-91a4-bae7c919fc72 None admin] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:23.450758 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f74fd-e3e2-404b-91a4-bae7c919fc72 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:23.451142 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f74fd-e3e2-404b-91a4-bae7c919fc72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:23.452057 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f74fd-e3e2-404b-91a4-bae7c919fc72 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:23.453613 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f74fd-e3e2-404b-91a4-bae7c919fc72 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:23.464616 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd915f0-0d25-4612-b914-031148604c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:23.465541 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd915f0-0d25-4612-b914-031148604c39 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:23.465909 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd915f0-0d25-4612-b914-031148604c39 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:23.466300 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd915f0-0d25-4612-b914-031148604c39 None admin] PATH_INFO: `/v3/services` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:23.467517 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd915f0-0d25-4612-b914-031148604c39 None admin] RBAC: Adding query filter params (type=network) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:23.468056 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd915f0-0d25-4612-b914-031148604c39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:23.470509 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd915f0-0d25-4612-b914-031148604c39 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:23.477942 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 369/738] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 27 09:40:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:40:23.478838 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f74fd-e3e2-404b-91a4-bae7c919fc72 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:23.487385 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 370/739] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Sep 27 09:40:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:23.490348 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e5bc5-1f38-4760-82c2-6ea7bbc960b8 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:23.490882 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e5bc5-1f38-4760-82c2-6ea7bbc960b8 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:23.491362 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e5bc5-1f38-4760-82c2-6ea7bbc960b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:23.522809 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-8d0e5bc5-1f38-4760-82c2-6ea7bbc960b8 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:23.524183 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-8d0e5bc5-1f38-4760-82c2-6ea7bbc960b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:23.539334 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:23.628944 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:23.642061 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f74fd-e3e2-404b-91a4-bae7c919fc72 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:23.653964 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 371/740] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:23 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 09:40:23.653964 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e5bc5-1f38-4760-82c2-6ea7bbc960b8 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:23.689897 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6392a5-a3fb-4354-85f9-1bfbd2688e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:23.691001 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6392a5-a3fb-4354-85f9-1bfbd2688e38 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:23.691468 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6392a5-a3fb-4354-85f9-1bfbd2688e38 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:23.691893 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6392a5-a3fb-4354-85f9-1bfbd2688e38 None admin] PATH_INFO: `/v3/domains` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:23.692732 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6392a5-a3fb-4354-85f9-1bfbd2688e38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:23.693195 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6392a5-a3fb-4354-85f9-1bfbd2688e38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:23.695051 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6392a5-a3fb-4354-85f9-1bfbd2688e38 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:23.711286 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 370/741] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:23.722813 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6392a5-a3fb-4354-85f9-1bfbd2688e38 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:23.860166 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e5bc5-1f38-4760-82c2-6ea7bbc960b8 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:23.909941 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6392a5-a3fb-4354-85f9-1bfbd2688e38 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:23.927869 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abadbe-8248-4d8e-aa1b-ba58a09d98e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:23.928886 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abadbe-8248-4d8e-aa1b-ba58a09d98e4 None admin] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:23.929366 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abadbe-8248-4d8e-aa1b-ba58a09d98e4 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:23.929834 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abadbe-8248-4d8e-aa1b-ba58a09d98e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:23.930744 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abadbe-8248-4d8e-aa1b-ba58a09d98e4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:23.932427 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abadbe-8248-4d8e-aa1b-ba58a09d98e4 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:23.958359 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:23.967801 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 372/742] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 27 09:40:23 2022] POST /identity/v3/endpoints => generated 337 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:40:23.994992 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087357fe-c69d-4335-bcef-cdfc08a75832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:23.996415 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087357fe-c69d-4335-bcef-cdfc08a75832 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:23.996990 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087357fe-c69d-4335-bcef-cdfc08a75832 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:23.997468 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087357fe-c69d-4335-bcef-cdfc08a75832 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:24.006437 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087357fe-c69d-4335-bcef-cdfc08a75832 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:24.008450 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087357fe-c69d-4335-bcef-cdfc08a75832 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:24.023678 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-087357fe-c69d-4335-bcef-cdfc08a75832 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:40:24.023678 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:24.023678 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:24.023678 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:24.023678 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:24.023678 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:24.023678 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:24.023678 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:24.023678 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:24.023678 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:24.023678 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:24.023678 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:24.023678 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 09:40:24.023678 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 09:40:24.023678 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 09:40:24.024690 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 09:40:24.024690 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:24.024690 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:24.024690 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:24.024690 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:24.024690 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:24.024690 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:24.024690 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:24.024690 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:24.024690 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:24.024690 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:24.024690 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:24.024690 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:24.024690 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:24.024690 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:24.024690 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:24.024690 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:24.025622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 09:40:24.025622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 09:40:24.025622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 09:40:24.025622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 09:40:24.025622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 09:40:24.025622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 09:40:24.025622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:40:24.025622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:24.028307 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 371/743] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:40:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:24.034828 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abadbe-8248-4d8e-aa1b-ba58a09d98e4 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:24.193034 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abadbe-8248-4d8e-aa1b-ba58a09d98e4 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:24.194846 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087357fe-c69d-4335-bcef-cdfc08a75832 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:24.223147 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:24.260810 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c05da-e9b1-4839-ad4e-ef32c2a915af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:24.261845 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c05da-e9b1-4839-ad4e-ef32c2a915af None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:24.262318 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c05da-e9b1-4839-ad4e-ef32c2a915af None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:24.262829 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c05da-e9b1-4839-ad4e-ef32c2a915af None admin] PATH_INFO: `/v3/projects` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:24.264468 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c05da-e9b1-4839-ad4e-ef32c2a915af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:24.266350 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c05da-e9b1-4839-ad4e-ef32c2a915af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:24.269497 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c05da-e9b1-4839-ad4e-ef32c2a915af None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:24.303804 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 373/744] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 27 09:40:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:24.311552 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c05da-e9b1-4839-ad4e-ef32c2a915af None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:24.399394 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087357fe-c69d-4335-bcef-cdfc08a75832 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:24.436099 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:24.477618 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778df8f-2439-479d-bad5-333a0feceeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:24.478655 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778df8f-2439-479d-bad5-333a0feceeb9 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:24.479186 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778df8f-2439-479d-bad5-333a0feceeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:24.479652 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778df8f-2439-479d-bad5-333a0feceeb9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:24.480711 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778df8f-2439-479d-bad5-333a0feceeb9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:24.483371 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778df8f-2439-479d-bad5-333a0feceeb9 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:24.502507 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-b778df8f-2439-479d-bad5-333a0feceeb9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 09:40:24.502507 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:24.502507 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 09:40:24.502507 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 09:40:24.502507 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 09:40:24.502507 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 09:40:24.502507 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 09:40:24.502507 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:24.502507 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 09:40:24.502507 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:24.502507 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 09:40:24.502507 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:24.502507 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:24.502507 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:24.502507 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:24.502507 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:24.502507 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:24.504522 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:24.504522 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:24.504522 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:24.504522 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:24.504522 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:24.504522 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:24.504522 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 09:40:24.504522 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 09:40:24.504522 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 09:40:24.504522 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 09:40:24.504522 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:24.504522 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:24.504522 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:24.504522 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:24.504522 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:24.504522 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:24.506150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:24.506150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:24.506150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:24.506150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:24.506150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:24.506150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:24.506150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:24.506150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:24.506150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:24.506150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:24.506150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 09:40:24.506150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:24.506150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 09:40:24.506150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:24.510689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c05da-e9b1-4839-ad4e-ef32c2a915af None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:24.514841 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 372/745] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 27 09:40:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:24.517782 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778df8f-2439-479d-bad5-333a0feceeb9 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:24.554560 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9ff26-de7f-4095-9bd2-089ab98d2a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:24.558894 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9ff26-de7f-4095-9bd2-089ab98d2a91 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:24.558894 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9ff26-de7f-4095-9bd2-089ab98d2a91 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:24.558894 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9ff26-de7f-4095-9bd2-089ab98d2a91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:24.558894 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9ff26-de7f-4095-9bd2-089ab98d2a91 None admin] RBAC: Adding query filter params (role.id=7cc7d3c85c794033b590117321e97ccf, scope.project.id=dbe5c492b05e40448942bb2500c185ee, user.id=bda026ed208d4736938da05121a06f4e) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:24.558894 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9ff26-de7f-4095-9bd2-089ab98d2a91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:24.561585 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9ff26-de7f-4095-9bd2-089ab98d2a91 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:24.575402 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 374/746] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:40:24 2022] GET /identity/v3/role_assignments?user.id=bda026ed208d4736938da05121a06f4e&scope.project.id=dbe5c492b05e40448942bb2500c185ee&role.id=7cc7d3c85c794033b590117321e97ccf => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:40:24.664836 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:24.708704 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778df8f-2439-479d-bad5-333a0feceeb9 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:24.772239 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14905a-7b49-43d6-a09a-0bed17c59f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:24.773198 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14905a-7b49-43d6-a09a-0bed17c59f1b None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:24.773613 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14905a-7b49-43d6-a09a-0bed17c59f1b None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:24.774035 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14905a-7b49-43d6-a09a-0bed17c59f1b None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:24.775120 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc14905a-7b49-43d6-a09a-0bed17c59f1b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:24.775605 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc14905a-7b49-43d6-a09a-0bed17c59f1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:24.777990 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc14905a-7b49-43d6-a09a-0bed17c59f1b None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:24.788293 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 373/747] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 27 09:40:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:24.796968 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9ff26-de7f-4095-9bd2-089ab98d2a91 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:24.999666 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9ff26-de7f-4095-9bd2-089ab98d2a91 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:25.051615 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:25.075284 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d5e3f-9129-4678-a153-ad09758334e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:25.076754 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d5e3f-9129-4678-a153-ad09758334e9 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:25.077459 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d5e3f-9129-4678-a153-ad09758334e9 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:25.078131 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d5e3f-9129-4678-a153-ad09758334e9 None admin] PATH_INFO: `/v3/services` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:25.079499 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d5e3f-9129-4678-a153-ad09758334e9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:25.080245 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d5e3f-9129-4678-a153-ad09758334e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:25.083615 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d5e3f-9129-4678-a153-ad09758334e9 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:25.093466 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 375/748] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 27 09:40:24 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:26.242303 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88365a77-9d27-49b2-a119-bb6b3e8d9763 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:26.242888 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88365a77-9d27-49b2-a119-bb6b3e8d9763 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:26.243300 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88365a77-9d27-49b2-a119-bb6b3e8d9763 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:26.245871 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 374/749] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:40:26.251908 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cdd2e-2d9b-4fcd-a439-1f6bf41791cb None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:26.252683 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cdd2e-2d9b-4fcd-a439-1f6bf41791cb None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:26.252683 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cdd2e-2d9b-4fcd-a439-1f6bf41791cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:26.273007 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-d09cdd2e-2d9b-4fcd-a439-1f6bf41791cb None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:26.274214 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-d09cdd2e-2d9b-4fcd-a439-1f6bf41791cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:26.358519 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 376/750] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:26 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 09:40:26.681440 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88365a77-9d27-49b2-a119-bb6b3e8d9763 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:26.800148 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88365a77-9d27-49b2-a119-bb6b3e8d9763 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:26.842523 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eed7f4-f448-41ca-ad05-611e71d20f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:26.843085 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eed7f4-f448-41ca-ad05-611e71d20f76 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:26.843356 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eed7f4-f448-41ca-ad05-611e71d20f76 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:26.843620 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eed7f4-f448-41ca-ad05-611e71d20f76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:26.856858 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:26.922091 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eed7f4-f448-41ca-ad05-611e71d20f76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:26.923614 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eed7f4-f448-41ca-ad05-611e71d20f76 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:27.086017 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 375/751] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:40:26 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 27 09:40:27.094962 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cdd2e-2d9b-4fcd-a439-1f6bf41791cb None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:27.264553 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cdd2e-2d9b-4fcd-a439-1f6bf41791cb None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:27.291287 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:27.326948 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21e1da-0d6b-4876-aae0-29655d2c9f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:27.327930 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21e1da-0d6b-4876-aae0-29655d2c9f1f None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:27.328420 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21e1da-0d6b-4876-aae0-29655d2c9f1f None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:27.328905 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21e1da-0d6b-4876-aae0-29655d2c9f1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:27.344492 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21e1da-0d6b-4876-aae0-29655d2c9f1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:27.346133 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21e1da-0d6b-4876-aae0-29655d2c9f1f None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:27.367334 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-eb21e1da-0d6b-4876-aae0-29655d2c9f1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:40:27.367334 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:27.367334 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:27.367334 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:27.367334 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:27.367334 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:27.367334 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:27.367334 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:27.367334 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:27.367334 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:27.367334 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:27.367334 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:27.367334 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:40:27.367334 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:40:27.367334 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:40:27.367334 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:40:27.375659 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:27.375659 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:27.375659 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:27.375659 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:27.375659 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:27.375659 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:27.375659 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:27.375659 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:27.375659 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:27.375659 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:27.375659 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:27.375659 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:27.375659 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:27.375659 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:27.375659 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:27.375659 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:27.375659 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:40:27.377686 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:40:27.377686 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:40:27.377686 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:27.377686 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 377/752] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:40:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:27.381417 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eed7f4-f448-41ca-ad05-611e71d20f76 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:27.436045 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:27.531873 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eed7f4-f448-41ca-ad05-611e71d20f76 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:27.601784 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccfb9f-1a56-4a67-9fc5-ce95c9bc0122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:27.602300 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccfb9f-1a56-4a67-9fc5-ce95c9bc0122 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:27.602604 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccfb9f-1a56-4a67-9fc5-ce95c9bc0122 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:27.602912 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccfb9f-1a56-4a67-9fc5-ce95c9bc0122 None admin] PATH_INFO: `/v3/domains` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:27.603693 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ccfb9f-1a56-4a67-9fc5-ce95c9bc0122 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:27.603997 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ccfb9f-1a56-4a67-9fc5-ce95c9bc0122 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:27.605434 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ccfb9f-1a56-4a67-9fc5-ce95c9bc0122 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:27.631447 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 376/753] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:40:27.857022 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0adac-f338-4460-b78f-0783c80c9454 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:27.857295 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0adac-f338-4460-b78f-0783c80c9454 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:27.857432 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0adac-f338-4460-b78f-0783c80c9454 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:27.859156 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 378/754] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:40:27.867209 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3ef3f-d518-4dd5-9807-512ff9192a82 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:27.868278 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3ef3f-d518-4dd5-9807-512ff9192a82 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:27.869028 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3ef3f-d518-4dd5-9807-512ff9192a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:27.899677 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-13e3ef3f-d518-4dd5-9807-512ff9192a82 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:27.901559 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-13e3ef3f-d518-4dd5-9807-512ff9192a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:28.014445 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c88f99-c33a-49e1-a353-83a905fb9a30 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:28.014858 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c88f99-c33a-49e1-a353-83a905fb9a30 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:28.015040 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c88f99-c33a-49e1-a353-83a905fb9a30 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:28.016532 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 379/755] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:40:28.022478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a606c4c-c68b-4f0f-9275-e951bed2f6a3 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:28.022755 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a606c4c-c68b-4f0f-9275-e951bed2f6a3 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:28.023056 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a606c4c-c68b-4f0f-9275-e951bed2f6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:28.030969 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 377/756] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:27 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 09:40:28.044127 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-0a606c4c-c68b-4f0f-9275-e951bed2f6a3 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:28.045338 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-0a606c4c-c68b-4f0f-9275-e951bed2f6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:28.134743 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 380/757] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:28 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 09:40:28.365276 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3ef3f-d518-4dd5-9807-512ff9192a82 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:28.402267 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:28.457072 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a606c4c-c68b-4f0f-9275-e951bed2f6a3 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:28.491670 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3ef3f-d518-4dd5-9807-512ff9192a82 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:28.551627 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db2804-ac79-4617-93e7-98384c0938b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:28.552545 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db2804-ac79-4617-93e7-98384c0938b0 None admin] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:28.552834 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db2804-ac79-4617-93e7-98384c0938b0 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:28.553278 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db2804-ac79-4617-93e7-98384c0938b0 None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:28.554362 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db2804-ac79-4617-93e7-98384c0938b0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:28.557112 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db2804-ac79-4617-93e7-98384c0938b0 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:28.577718 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:28.579513 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 378/758] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Sep 27 09:40:28 2022] POST /identity/v3/services => generated 251 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 09:40:28.582707 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a606c4c-c68b-4f0f-9275-e951bed2f6a3 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:28.649289 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b88aa-d26d-4b58-b02c-874b2fdf45ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:28.650318 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b88aa-d26d-4b58-b02c-874b2fdf45ff None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:28.650718 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b88aa-d26d-4b58-b02c-874b2fdf45ff None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:28.651149 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b88aa-d26d-4b58-b02c-874b2fdf45ff None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:28.652031 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b88aa-d26d-4b58-b02c-874b2fdf45ff None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:28.654247 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b88aa-d26d-4b58-b02c-874b2fdf45ff None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:28.666602 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-4b0b88aa-d26d-4b58-b02c-874b2fdf45ff None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 09:40:28.666602 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:28.666602 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 09:40:28.666602 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 09:40:28.666602 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 09:40:28.666602 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 09:40:28.666602 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 09:40:28.666602 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:28.666602 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 09:40:28.666602 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:28.666602 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 09:40:28.666602 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:28.666602 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:28.666602 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:28.666602 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:28.666602 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:28.668707 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:28.668707 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:28.668707 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:28.668707 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:28.668707 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:28.668707 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:28.668707 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:28.668707 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 09:40:28.668707 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 09:40:28.668707 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 09:40:28.668707 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 09:40:28.668707 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:28.668707 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:28.668707 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:28.668707 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:28.668707 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:28.668707 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:28.669841 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:28.669841 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:28.669841 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:28.669841 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:28.669841 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:28.669841 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:28.669841 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:28.669841 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:28.669841 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:28.669841 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:28.669841 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 09:40:28.669841 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:28.669841 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 09:40:28.669841 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:28.669841 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 381/759] 10.222.0.49 () {56 vars in 1132 bytes} [Tue Sep 27 09:40:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 09:40:28.677876 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db2804-ac79-4617-93e7-98384c0938b0 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:28.793497 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:28.808661 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db2804-ac79-4617-93e7-98384c0938b0 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:28.848050 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf89fe-87ca-45f6-8556-64263d89756c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:28.848797 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf89fe-87ca-45f6-8556-64263d89756c None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:28.848961 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf89fe-87ca-45f6-8556-64263d89756c None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:28.849207 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf89fe-87ca-45f6-8556-64263d89756c None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:28.849938 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf89fe-87ca-45f6-8556-64263d89756c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:28.850249 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf89fe-87ca-45f6-8556-64263d89756c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:28.851677 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf89fe-87ca-45f6-8556-64263d89756c None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:28.857120 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 379/760] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Sep 27 09:40:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:28.863145 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b88aa-d26d-4b58-b02c-874b2fdf45ff None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:28.985262 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b88aa-d26d-4b58-b02c-874b2fdf45ff None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:29.026142 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a717c-051d-4659-b4e6-8ec8d3558707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:29.026794 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a717c-051d-4659-b4e6-8ec8d3558707 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:29.027082 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a717c-051d-4659-b4e6-8ec8d3558707 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:29.027348 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a717c-051d-4659-b4e6-8ec8d3558707 None admin] PATH_INFO: `/v3/services` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:29.027994 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a717c-051d-4659-b4e6-8ec8d3558707 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:29.028293 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a717c-051d-4659-b4e6-8ec8d3558707 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:29.029709 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a717c-051d-4659-b4e6-8ec8d3558707 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:29.035276 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 382/761] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Sep 27 09:40:28 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:31.336886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e261513-7cd0-4903-a52c-3f4a2584c52f None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:31.337484 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e261513-7cd0-4903-a52c-3f4a2584c52f None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:31.337847 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e261513-7cd0-4903-a52c-3f4a2584c52f None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:31.340527 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 380/762] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:40:31.350163 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fc380-8e9e-4312-8a5f-cf9b41d6ab33 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:31.350748 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fc380-8e9e-4312-8a5f-cf9b41d6ab33 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:31.351130 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fc380-8e9e-4312-8a5f-cf9b41d6ab33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:31.383160 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-185fc380-8e9e-4312-8a5f-cf9b41d6ab33 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:31.384936 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-185fc380-8e9e-4312-8a5f-cf9b41d6ab33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:31.404933 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:31.465199 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 383/763] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:31 2022] POST /identity/v3/auth/tokens => generated 1507 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 09:40:31.538533 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988b161-c5e6-4c04-9dd0-49c67942dc41 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:31.539005 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988b161-c5e6-4c04-9dd0-49c67942dc41 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:31.539323 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988b161-c5e6-4c04-9dd0-49c67942dc41 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:31.541843 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 381/764] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:40:31.550010 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746880b6-3952-4144-9c44-e8ca6e810087 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:31.550447 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746880b6-3952-4144-9c44-e8ca6e810087 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:31.550905 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746880b6-3952-4144-9c44-e8ca6e810087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:31.571950 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-746880b6-3952-4144-9c44-e8ca6e810087 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:31.573368 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-746880b6-3952-4144-9c44-e8ca6e810087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:31.653701 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 384/765] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:31 2022] POST /identity/v3/auth/tokens => generated 1507 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 09:40:31.789689 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988b161-c5e6-4c04-9dd0-49c67942dc41 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:31.915376 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988b161-c5e6-4c04-9dd0-49c67942dc41 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:31.955324 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb60f57-91d8-4e4a-91d7-5a4277aaf93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:31.955979 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb60f57-91d8-4e4a-91d7-5a4277aaf93a None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:31.956249 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb60f57-91d8-4e4a-91d7-5a4277aaf93a None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:31.956517 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb60f57-91d8-4e4a-91d7-5a4277aaf93a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:31.957101 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb60f57-91d8-4e4a-91d7-5a4277aaf93a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:31.958849 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb60f57-91d8-4e4a-91d7-5a4277aaf93a None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:31.968760 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-6fb60f57-91d8-4e4a-91d7-5a4277aaf93a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 09:40:31.968760 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:31.968760 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 09:40:31.968760 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 09:40:31.968760 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 09:40:31.968760 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 09:40:31.968760 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 09:40:31.968760 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:31.968760 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 09:40:31.968760 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:31.968760 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 09:40:31.968760 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:31.968760 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:31.968760 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:31.968760 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:31.968760 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:31.968760 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:31.971072 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:31.971072 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:31.971072 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:31.971072 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:31.971072 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:31.971072 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:31.971072 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 09:40:31.971072 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 09:40:31.971072 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 09:40:31.971072 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 09:40:31.971072 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:31.971072 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:31.971072 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:31.971072 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:31.971072 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:31.971072 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:31.972767 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:31.972767 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:31.972767 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:31.972767 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:31.972767 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:31.972767 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:31.972767 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:31.972767 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:31.972767 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:31.972767 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:31.972767 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 09:40:31.972767 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:31.972767 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 09:40:31.972767 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:31.972767 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 382/766] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 27 09:40:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:31.974452 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746880b6-3952-4144-9c44-e8ca6e810087 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:31.976542 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb60f57-91d8-4e4a-91d7-5a4277aaf93a None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:31.997203 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:32.089908 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb60f57-91d8-4e4a-91d7-5a4277aaf93a None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:32.105959 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:32.135639 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efae99-12de-442a-8c4a-8fff1278db9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:32.136271 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efae99-12de-442a-8c4a-8fff1278db9a None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:32.136543 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efae99-12de-442a-8c4a-8fff1278db9a None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:32.136810 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efae99-12de-442a-8c4a-8fff1278db9a None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:32.137452 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efae99-12de-442a-8c4a-8fff1278db9a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:32.137751 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efae99-12de-442a-8c4a-8fff1278db9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:32.139243 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efae99-12de-442a-8c4a-8fff1278db9a None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:32.144696 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 383/767] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 27 09:40:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:40:32.150961 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efae99-12de-442a-8c4a-8fff1278db9a None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:32.152611 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746880b6-3952-4144-9c44-e8ca6e810087 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:32.209139 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba79391-698a-4853-b6a2-dbaf8a3812da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:32.210153 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba79391-698a-4853-b6a2-dbaf8a3812da None admin] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:32.210551 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba79391-698a-4853-b6a2-dbaf8a3812da None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:32.211066 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba79391-698a-4853-b6a2-dbaf8a3812da None admin] PATH_INFO: `/v3/services` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:32.212318 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba79391-698a-4853-b6a2-dbaf8a3812da None admin] RBAC: Authorizing `identity:create_service()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:32.215072 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba79391-698a-4853-b6a2-dbaf8a3812da None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:32.234974 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 385/768] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Sep 27 09:40:31 2022] POST /identity/v3/services => generated 269 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:40:32.260114 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:32.286294 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efae99-12de-442a-8c4a-8fff1278db9a None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:32.339537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c4e7f-ac10-45c7-b206-b64928465679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:32.340664 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c4e7f-ac10-45c7-b206-b64928465679 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:32.340664 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c4e7f-ac10-45c7-b206-b64928465679 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:32.340664 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c4e7f-ac10-45c7-b206-b64928465679 None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:32.341317 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c4e7f-ac10-45c7-b206-b64928465679 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:32.341614 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c4e7f-ac10-45c7-b206-b64928465679 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:32.343072 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c4e7f-ac10-45c7-b206-b64928465679 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:32.350093 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 384/769] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 27 09:40:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:40:32.356562 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba79391-698a-4853-b6a2-dbaf8a3812da None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:32.495285 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba79391-698a-4853-b6a2-dbaf8a3812da None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:32.543875 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a0212-90c5-470e-b3ee-0d925d7ba6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:32.544874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a0212-90c5-470e-b3ee-0d925d7ba6b2 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:32.545348 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a0212-90c5-470e-b3ee-0d925d7ba6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:32.545785 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a0212-90c5-470e-b3ee-0d925d7ba6b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:32.547105 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a0212-90c5-470e-b3ee-0d925d7ba6b2 None admin] RBAC: Adding query filter params (interface=public, service_id=2d8d1f0617324d1bb4084e4e08e3e734, region_id=RegionOne) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:32.547622 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a0212-90c5-470e-b3ee-0d925d7ba6b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:32.550166 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a0212-90c5-470e-b3ee-0d925d7ba6b2 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:32.558683 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 386/770] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Sep 27 09:40:32 2022] GET /identity/v3/endpoints?service_id=2d8d1f0617324d1bb4084e4e08e3e734&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:40:32.566044 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c4e7f-ac10-45c7-b206-b64928465679 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:32.739542 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c4e7f-ac10-45c7-b206-b64928465679 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:32.780019 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1db3b1-a14b-4dbd-9b4d-e76f89ea9941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:32.780636 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1db3b1-a14b-4dbd-9b4d-e76f89ea9941 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:32.780905 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1db3b1-a14b-4dbd-9b4d-e76f89ea9941 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:32.781171 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1db3b1-a14b-4dbd-9b4d-e76f89ea9941 None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:32.781774 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1db3b1-a14b-4dbd-9b4d-e76f89ea9941 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:32.783201 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1db3b1-a14b-4dbd-9b4d-e76f89ea9941 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:32.791489 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 385/771] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Sep 27 09:40:32 2022] GET /identity/v3/services => generated 1498 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 09:40:34.847622 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12894eb-5c9c-4821-a9b8-74dc1c39b640 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:34.848179 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12894eb-5c9c-4821-a9b8-74dc1c39b640 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:34.848410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12894eb-5c9c-4821-a9b8-74dc1c39b640 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:34.850801 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 387/772] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:40:34.857315 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f5520-b905-4255-9ea3-93d15239eab0 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:34.858202 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f5520-b905-4255-9ea3-93d15239eab0 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:34.858202 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f5520-b905-4255-9ea3-93d15239eab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:34.872816 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:34.880576 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-d08f5520-b905-4255-9ea3-93d15239eab0 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:34.881870 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-d08f5520-b905-4255-9ea3-93d15239eab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:34.963631 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 386/773] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:34 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 09:40:35.282480 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12894eb-5c9c-4821-a9b8-74dc1c39b640 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:35.301522 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:35.323329 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289fba1-f8e7-4732-8673-b81b68ea3bd7 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:35.324120 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289fba1-f8e7-4732-8673-b81b68ea3bd7 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:35.324504 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289fba1-f8e7-4732-8673-b81b68ea3bd7 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:35.326222 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 387/774] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:40:35.331580 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b88923-3e08-4543-a2ed-cd13b86e155d None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:35.331855 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b88923-3e08-4543-a2ed-cd13b86e155d None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:35.332152 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b88923-3e08-4543-a2ed-cd13b86e155d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:35.351891 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-93b88923-3e08-4543-a2ed-cd13b86e155d None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:35.353134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-93b88923-3e08-4543-a2ed-cd13b86e155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:35.430362 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 388/775] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:35 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 09:40:35.445903 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12894eb-5c9c-4821-a9b8-74dc1c39b640 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:35.488439 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175b68e-129e-4342-9893-fce2e11e5a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:35.489160 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175b68e-129e-4342-9893-fce2e11e5a2c None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:35.490000 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175b68e-129e-4342-9893-fce2e11e5a2c None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:35.490000 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175b68e-129e-4342-9893-fce2e11e5a2c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:35.490502 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175b68e-129e-4342-9893-fce2e11e5a2c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:35.492032 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175b68e-129e-4342-9893-fce2e11e5a2c None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:35.502123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-9175b68e-129e-4342-9893-fce2e11e5a2c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 09:40:35.502123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:35.502123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 09:40:35.502123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 09:40:35.502123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 09:40:35.502123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 09:40:35.502123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 09:40:35.502123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:35.502123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 09:40:35.502123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:35.502123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 09:40:35.502123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:35.502123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:35.502123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:35.502123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:35.502123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:35.504022 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:35.504022 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:35.504022 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:35.504022 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:35.504022 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:35.504022 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:35.504022 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:35.504022 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 09:40:35.504022 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 09:40:35.504022 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 09:40:35.504022 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 09:40:35.504022 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:35.504022 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:35.504022 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:35.504022 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:35.504022 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:35.504022 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:35.505917 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:35.505917 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:35.505917 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:35.505917 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:35.505917 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:35.505917 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:35.505917 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:35.505917 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:35.505917 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:35.505917 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:35.505917 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 09:40:35.505917 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:35.505917 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 09:40:35.505917 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:35.505917 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 388/776] 10.222.0.49 () {56 vars in 1132 bytes} [Tue Sep 27 09:40:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:35.510567 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b88923-3e08-4543-a2ed-cd13b86e155d None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:35.592874 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:35.633361 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b88923-3e08-4543-a2ed-cd13b86e155d None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:35.672154 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d6575-9d65-4634-a654-25c3130050ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:35.672773 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d6575-9d65-4634-a654-25c3130050ff None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:35.673050 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d6575-9d65-4634-a654-25c3130050ff None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:35.673381 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d6575-9d65-4634-a654-25c3130050ff None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:35.674020 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d6575-9d65-4634-a654-25c3130050ff None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:35.674322 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d6575-9d65-4634-a654-25c3130050ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:35.675746 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d6575-9d65-4634-a654-25c3130050ff None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:35.681600 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 389/777] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Sep 27 09:40:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:40:35.687767 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175b68e-129e-4342-9893-fce2e11e5a2c None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:35.765268 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:35.768682 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d6575-9d65-4634-a654-25c3130050ff None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:35.805992 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175b68e-129e-4342-9893-fce2e11e5a2c None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:35.851361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f086be-94ac-4c4a-a15c-7236cd87f60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:35.852095 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f086be-94ac-4c4a-a15c-7236cd87f60d None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:35.852185 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f086be-94ac-4c4a-a15c-7236cd87f60d None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:35.852443 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f086be-94ac-4c4a-a15c-7236cd87f60d None admin] PATH_INFO: `/v3/services` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:35.853086 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f086be-94ac-4c4a-a15c-7236cd87f60d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:35.853383 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f086be-94ac-4c4a-a15c-7236cd87f60d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:35.854843 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f086be-94ac-4c4a-a15c-7236cd87f60d None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:35.860250 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 389/778] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Sep 27 09:40:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:35.868100 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f086be-94ac-4c4a-a15c-7236cd87f60d None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:35.895568 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d6575-9d65-4634-a654-25c3130050ff None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:35.942117 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:35.951101 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20cd54f-d583-450d-875e-278d77e942a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:35.951973 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cd54f-d583-450d-875e-278d77e942a5 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:35.952432 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cd54f-d583-450d-875e-278d77e942a5 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:35.952751 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cd54f-d583-450d-875e-278d77e942a5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:35.953396 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20cd54f-d583-450d-875e-278d77e942a5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:35.955172 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20cd54f-d583-450d-875e-278d77e942a5 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:35.966847 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-e20cd54f-d583-450d-875e-278d77e942a5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 09:40:35.966847 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:35.966847 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 09:40:35.966847 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 09:40:35.966847 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 09:40:35.966847 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 09:40:35.966847 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 09:40:35.966847 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:35.966847 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 09:40:35.966847 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:35.966847 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 09:40:35.966847 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:35.966847 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:35.966847 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:35.966847 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:35.966847 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:35.966847 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:35.968944 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:35.968944 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:35.968944 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:35.968944 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:35.968944 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:35.968944 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:35.968944 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 09:40:35.968944 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 09:40:35.968944 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 09:40:35.968944 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 09:40:35.968944 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:35.968944 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:35.968944 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:35.968944 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:35.968944 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:35.968944 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:35.970149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:35.970149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:35.970149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:35.970149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:35.970149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:35.970149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:35.970149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:35.970149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:35.970149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:35.970149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:35.970149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 09:40:35.970149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:35.970149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 09:40:35.970149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:35.970149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 390/779] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 27 09:40:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 09:40:35.976469 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20cd54f-d583-450d-875e-278d77e942a5 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:36.009710 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f086be-94ac-4c4a-a15c-7236cd87f60d None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:36.050866 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecdc5d-5136-4651-ab72-fa90a6f90172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:36.051800 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecdc5d-5136-4651-ab72-fa90a6f90172 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:36.052209 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecdc5d-5136-4651-ab72-fa90a6f90172 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:36.052639 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecdc5d-5136-4651-ab72-fa90a6f90172 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:36.053719 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecdc5d-5136-4651-ab72-fa90a6f90172 None admin] RBAC: Adding query filter params (interface=public, service_id=cef53cea611d41b1a72032937aec0e07, region_id=RegionOne) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:36.054176 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecdc5d-5136-4651-ab72-fa90a6f90172 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:36.056576 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecdc5d-5136-4651-ab72-fa90a6f90172 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:36.059554 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:36.066025 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 390/780] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Sep 27 09:40:35 2022] GET /identity/v3/endpoints?service_id=cef53cea611d41b1a72032937aec0e07&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:36.072525 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecdc5d-5136-4651-ab72-fa90a6f90172 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:36.128504 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20cd54f-d583-450d-875e-278d77e942a5 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:36.174739 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b2996-c919-4407-b8bd-5e2bdf414c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:36.175479 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b2996-c919-4407-b8bd-5e2bdf414c04 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:36.175789 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b2996-c919-4407-b8bd-5e2bdf414c04 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:36.176109 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b2996-c919-4407-b8bd-5e2bdf414c04 None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:36.176892 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b2996-c919-4407-b8bd-5e2bdf414c04 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:36.177228 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b2996-c919-4407-b8bd-5e2bdf414c04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:36.178756 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b2996-c919-4407-b8bd-5e2bdf414c04 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:36.184339 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 391/781] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 27 09:40:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:40:36.190498 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b2996-c919-4407-b8bd-5e2bdf414c04 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:36.199279 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecdc5d-5136-4651-ab72-fa90a6f90172 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:36.242438 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e2a3d-2afd-490c-848d-de8d07218bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:36.243216 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e2a3d-2afd-490c-848d-de8d07218bbf None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:36.243565 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e2a3d-2afd-490c-848d-de8d07218bbf None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:36.243893 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e2a3d-2afd-490c-848d-de8d07218bbf None admin] PATH_INFO: `/v3/services` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:36.244762 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e2a3d-2afd-490c-848d-de8d07218bbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:36.246214 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e2a3d-2afd-490c-848d-de8d07218bbf None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:36.253227 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 391/782] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Sep 27 09:40:36 2022] GET /identity/v3/services => generated 1498 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 09:40:36.267259 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:36.325810 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b2996-c919-4407-b8bd-5e2bdf414c04 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:36.381150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24ee57-bc31-4973-aeab-6f91eaf769f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:36.381698 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24ee57-bc31-4973-aeab-6f91eaf769f3 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:36.381977 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24ee57-bc31-4973-aeab-6f91eaf769f3 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:36.382253 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24ee57-bc31-4973-aeab-6f91eaf769f3 None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:36.382964 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24ee57-bc31-4973-aeab-6f91eaf769f3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:36.383271 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24ee57-bc31-4973-aeab-6f91eaf769f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:36.384767 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24ee57-bc31-4973-aeab-6f91eaf769f3 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:36.392444 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 392/783] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Sep 27 09:40:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:40:36.400293 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e2a3d-2afd-490c-848d-de8d07218bbf None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:36.519338 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:36.583680 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e2a3d-2afd-490c-848d-de8d07218bbf None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:36.633221 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f291f-596b-4b1b-8c6e-a3a98f842772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:36.633730 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f291f-596b-4b1b-8c6e-a3a98f842772 None admin] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:36.634003 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f291f-596b-4b1b-8c6e-a3a98f842772 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:36.634266 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f291f-596b-4b1b-8c6e-a3a98f842772 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:36.634982 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f291f-596b-4b1b-8c6e-a3a98f842772 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:36.636366 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f291f-596b-4b1b-8c6e-a3a98f842772 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:36.663789 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 392/784] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 27 09:40:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:40:38.882689 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed303242-849f-48a8-afcb-8301c39cb77d None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:38.883370 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed303242-849f-48a8-afcb-8301c39cb77d None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:38.883370 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed303242-849f-48a8-afcb-8301c39cb77d None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:38.884529 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 393/785] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:40:38.892173 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f50f47-a5cc-4a9a-9dbc-c56e37877db6 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:38.892732 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f50f47-a5cc-4a9a-9dbc-c56e37877db6 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:38.893153 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f50f47-a5cc-4a9a-9dbc-c56e37877db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:38.913002 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-57f50f47-a5cc-4a9a-9dbc-c56e37877db6 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:38.914206 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-57f50f47-a5cc-4a9a-9dbc-c56e37877db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:38.992828 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 393/786] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:38 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 09:40:39.232276 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55331883-4bb8-484a-ab6a-9e39ae6efe62 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:39.232499 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55331883-4bb8-484a-ab6a-9e39ae6efe62 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:39.232688 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55331883-4bb8-484a-ab6a-9e39ae6efe62 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:39.234029 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 394/787] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:40:39.240123 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7eac2b-dbe8-4350-8818-6717ff66502b None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:39.240493 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7eac2b-dbe8-4350-8818-6717ff66502b None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:39.240874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7eac2b-dbe8-4350-8818-6717ff66502b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:39.261531 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-bd7eac2b-dbe8-4350-8818-6717ff66502b None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:39.262753 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-bd7eac2b-dbe8-4350-8818-6717ff66502b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:39.311166 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:39.320805 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55331883-4bb8-484a-ab6a-9e39ae6efe62 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:39.343008 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 394/788] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:39 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 09:40:39.434738 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55331883-4bb8-484a-ab6a-9e39ae6efe62 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:39.458653 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:39.472012 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4564343-8ac5-41b1-b7bb-a2376f9836b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:39.472653 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4564343-8ac5-41b1-b7bb-a2376f9836b8 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:39.472932 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4564343-8ac5-41b1-b7bb-a2376f9836b8 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:39.473205 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4564343-8ac5-41b1-b7bb-a2376f9836b8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:39.473966 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4564343-8ac5-41b1-b7bb-a2376f9836b8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:39.475540 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4564343-8ac5-41b1-b7bb-a2376f9836b8 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:39.485071 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-d4564343-8ac5-41b1-b7bb-a2376f9836b8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 09:40:39.485071 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:39.485071 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 09:40:39.485071 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 09:40:39.485071 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 09:40:39.485071 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 09:40:39.485071 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 09:40:39.485071 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:39.485071 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 09:40:39.485071 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:39.485071 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 09:40:39.485071 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:39.485071 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:39.485071 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:39.485071 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:39.485071 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:39.486149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:39.486149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:39.486149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:39.486149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:39.486149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:39.486149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:39.486149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:39.486149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 09:40:39.486149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 09:40:39.486149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 09:40:39.486149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 09:40:39.486149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:39.486149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:39.486149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:39.486149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:39.486149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:39.486149 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:39.487301 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:39.487301 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:39.487301 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:39.487301 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:39.487301 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:39.487301 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:39.487301 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:39.487301 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:39.487301 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:39.487301 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:39.487301 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 09:40:39.487301 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:39.487301 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 09:40:39.487301 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:39.487301 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 395/789] 10.222.0.49 () {56 vars in 1132 bytes} [Tue Sep 27 09:40:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 09:40:39.492828 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7eac2b-dbe8-4350-8818-6717ff66502b None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:39.605500 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7eac2b-dbe8-4350-8818-6717ff66502b None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:39.644404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb5453-50a4-4973-9acb-95ea1d55bd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:39.645022 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb5453-50a4-4973-9acb-95ea1d55bd35 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:39.645302 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb5453-50a4-4973-9acb-95ea1d55bd35 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:39.645703 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb5453-50a4-4973-9acb-95ea1d55bd35 None admin] PATH_INFO: `/v3/services` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:39.646558 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb5453-50a4-4973-9acb-95ea1d55bd35 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:39.646973 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb5453-50a4-4973-9acb-95ea1d55bd35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:39.648371 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb5453-50a4-4973-9acb-95ea1d55bd35 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:39.653651 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 395/790] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Sep 27 09:40:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:39.660667 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4564343-8ac5-41b1-b7bb-a2376f9836b8 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:39.676751 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb5453-50a4-4973-9acb-95ea1d55bd35 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:39.719153 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:39.772140 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4564343-8ac5-41b1-b7bb-a2376f9836b8 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:39.786828 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb5453-50a4-4973-9acb-95ea1d55bd35 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:39.816569 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799a561-54f0-450e-b0ab-b8751082e44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:39.817580 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799a561-54f0-450e-b0ab-b8751082e44f None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:39.818144 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799a561-54f0-450e-b0ab-b8751082e44f None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:39.818506 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799a561-54f0-450e-b0ab-b8751082e44f None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:39.819316 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799a561-54f0-450e-b0ab-b8751082e44f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:39.819717 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799a561-54f0-450e-b0ab-b8751082e44f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:39.821546 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799a561-54f0-450e-b0ab-b8751082e44f None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:39.826187 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b1ada-cb0c-4558-8590-c3a0ce8af8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:39.826828 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b1ada-cb0c-4558-8590-c3a0ce8af8d9 None admin] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:39.827104 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b1ada-cb0c-4558-8590-c3a0ce8af8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:39.827368 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b1ada-cb0c-4558-8590-c3a0ce8af8d9 None admin] PATH_INFO: `/v3/projects` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:39.828016 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b1ada-cb0c-4558-8590-c3a0ce8af8d9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:39.828306 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 396/791] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Sep 27 09:40:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:39.829484 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b1ada-cb0c-4558-8590-c3a0ce8af8d9 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:39.832203 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: WARNING keystone.server.flask.common [None req-268b1ada-cb0c-4558-8590-c3a0ce8af8d9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 27 09:40:39.834575 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799a561-54f0-450e-b0ab-b8751082e44f None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:39.854260 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.sql.core [None req-268b1ada-cb0c-4558-8590-c3a0ce8af8d9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 27 09:40:39.854260 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 27 09:40:39.854260 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [parameters: {'id': '36f9a6e8371649748c0aa38d343ed52f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 27 09:40:39.854260 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=99839) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 27 09:40:39.871601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-268b1ada-cb0c-4558-8590-c3a0ce8af8d9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 36f9a6e8371649748c0aa38d343ed52f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 36f9a6e8371649748c0aa38d343ed52f. Sep 27 09:40:39.871601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:39.871601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 27 09:40:39.871601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 27 09:40:39.871601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 27 09:40:39.871601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 27 09:40:39.871601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 27 09:40:39.871601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application result = self._query(query) Sep 27 09:40:39.871601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 27 09:40:39.871601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application conn.query(q) Sep 27 09:40:39.871601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 27 09:40:39.871601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 27 09:40:39.871601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 27 09:40:39.873057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application result.read() Sep 27 09:40:39.873057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 27 09:40:39.873057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 27 09:40:39.873057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 27 09:40:39.873057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 27 09:40:39.873057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 27 09:40:39.873057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 27 09:40:39.873057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 27 09:40:39.873057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 27 09:40:39.873057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 27 09:40:39.873057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:39.873057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 27 09:40:39.873057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:39.873057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:39.873057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 27 09:40:39.873057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 27 09:40:39.873057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 27 09:40:39.873057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 27 09:40:39.874878 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 27 09:40:39.874878 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application next(self.gen) Sep 27 09:40:39.874878 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 27 09:40:39.874878 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application yield resource Sep 27 09:40:39.874878 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 27 09:40:39.874878 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application next(self.gen) Sep 27 09:40:39.874878 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 27 09:40:39.874878 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self.session.rollback() Sep 27 09:40:39.874878 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 09:40:39.874878 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self.force_reraise() Sep 27 09:40:39.874878 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 09:40:39.874878 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise self.value Sep 27 09:40:39.874878 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 27 09:40:39.874878 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 27 09:40:39.874878 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 27 09:40:39.874878 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application session.commit() Sep 27 09:40:39.874878 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 27 09:40:39.876803 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 27 09:40:39.876803 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 27 09:40:39.876803 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self._prepare_impl() Sep 27 09:40:39.876803 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 27 09:40:39.876803 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self.session.flush() Sep 27 09:40:39.876803 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 27 09:40:39.876803 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self._flush(objects) Sep 27 09:40:39.876803 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 27 09:40:39.876803 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 27 09:40:39.876803 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 27 09:40:39.876803 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application compat.raise_( Sep 27 09:40:39.876803 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 27 09:40:39.876803 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception Sep 27 09:40:39.876803 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 27 09:40:39.876803 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application flush_context.execute() Sep 27 09:40:39.876803 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 27 09:40:39.876803 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rec.execute(self) Sep 27 09:40:39.878757 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 27 09:40:39.878757 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 27 09:40:39.878757 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 27 09:40:39.878757 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 27 09:40:39.878757 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 27 09:40:39.878757 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 27 09:40:39.878757 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 27 09:40:39.878757 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 27 09:40:39.878757 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 27 09:40:39.878757 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 27 09:40:39.878757 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 27 09:40:39.878757 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 27 09:40:39.878757 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 27 09:40:39.878757 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 27 09:40:39.878757 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 27 09:40:39.880535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 27 09:40:39.880535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 27 09:40:39.880535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception Sep 27 09:40:39.880535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 27 09:40:39.880535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 27 09:40:39.880535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 27 09:40:39.880535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 27 09:40:39.880535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 27 09:40:39.880535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application result = self._query(query) Sep 27 09:40:39.880535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 27 09:40:39.880535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application conn.query(q) Sep 27 09:40:39.880535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 27 09:40:39.880535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 27 09:40:39.880535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 27 09:40:39.880535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application result.read() Sep 27 09:40:39.880535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 27 09:40:39.880535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 27 09:40:39.882668 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 27 09:40:39.882668 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 27 09:40:39.882668 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 27 09:40:39.882668 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 27 09:40:39.882668 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 27 09:40:39.882668 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 27 09:40:39.882668 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 27 09:40:39.882668 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 27 09:40:39.882668 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [parameters: {'id': '36f9a6e8371649748c0aa38d343ed52f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 27 09:40:39.882668 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 27 09:40:39.882668 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:39.882668 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 09:40:39.882668 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:39.882668 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:39.882668 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 27 09:40:39.885412 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 27 09:40:39.885412 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 27 09:40:39.885412 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 27 09:40:39.885412 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 27 09:40:39.885412 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:39.885412 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 09:40:39.885412 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:39.885412 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:39.885412 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:39.885412 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:39.885412 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:39.885412 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:39.885412 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:39.885412 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:39.885412 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:39.885412 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:39.885412 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:39.887438 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:39.887438 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 27 09:40:39.887438 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 27 09:40:39.887438 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:39.887438 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:39.887438 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 27 09:40:39.887438 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 27 09:40:39.887438 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 36f9a6e8371649748c0aa38d343ed52f. Sep 27 09:40:39.887438 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:39.887438 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 396/792] 10.222.0.49 () {60 vars in 1140 bytes} [Tue Sep 27 09:40:39 2022] POST /identity/v3/projects => generated 262 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:39.887438 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b1ada-cb0c-4558-8590-c3a0ce8af8d9 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:39.901900 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:39.959675 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799a561-54f0-450e-b0ab-b8751082e44f None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:39.997982 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c81e8-51b4-4285-b5e0-8c56a9fbe536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:39.998603 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c81e8-51b4-4285-b5e0-8c56a9fbe536 None admin] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:39.998913 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c81e8-51b4-4285-b5e0-8c56a9fbe536 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:39.999191 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c81e8-51b4-4285-b5e0-8c56a9fbe536 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:39.999860 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c81e8-51b4-4285-b5e0-8c56a9fbe536 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:40.001243 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c81e8-51b4-4285-b5e0-8c56a9fbe536 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:40.022823 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:40.024938 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 397/793] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 27 09:40:39 2022] POST /identity/v3/endpoints => generated 347 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:40:40.033078 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b1ada-cb0c-4558-8590-c3a0ce8af8d9 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:40.090472 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f1d9b-f844-4d39-8605-71e9f66e5bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:40.091416 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f1d9b-f844-4d39-8605-71e9f66e5bda None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:40.091785 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f1d9b-f844-4d39-8605-71e9f66e5bda None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:40.092162 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f1d9b-f844-4d39-8605-71e9f66e5bda None admin] PATH_INFO: `/v3/projects/service` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:40.100932 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f1d9b-f844-4d39-8605-71e9f66e5bda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:40.102743 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f1d9b-f844-4d39-8605-71e9f66e5bda None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:40.117361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-a61f1d9b-f844-4d39-8605-71e9f66e5bda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:40:40.117361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:40.117361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:40.117361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:40.117361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:40.117361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:40.117361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:40.117361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:40.117361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:40.117361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:40.117361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:40.117361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:40.117361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 09:40:40.117361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 09:40:40.117361 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 09:40:40.119369 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 09:40:40.119369 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:40.119369 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:40.119369 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:40.119369 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:40.119369 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:40.119369 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:40.119369 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:40.119369 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:40.119369 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:40.119369 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:40.119369 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:40.119369 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:40.119369 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:40.119369 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:40.119369 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:40.119369 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:40.121062 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 09:40:40.121062 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 09:40:40.121062 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 09:40:40.121062 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 09:40:40.121062 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 09:40:40.121062 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 09:40:40.121062 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:40:40.121062 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:40.121062 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 397/794] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:40:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:40.126927 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c81e8-51b4-4285-b5e0-8c56a9fbe536 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:40.299571 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c81e8-51b4-4285-b5e0-8c56a9fbe536 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:40.309174 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:40.350055 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55625e-b761-477a-a848-1b4508adfbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:40.350695 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55625e-b761-477a-a848-1b4508adfbdb None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:40.351019 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55625e-b761-477a-a848-1b4508adfbdb None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:40.351287 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55625e-b761-477a-a848-1b4508adfbdb None admin] PATH_INFO: `/v3/projects` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:40.351981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55625e-b761-477a-a848-1b4508adfbdb None admin] RBAC: Adding query filter params (name=service) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:40.352281 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55625e-b761-477a-a848-1b4508adfbdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:40.353762 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55625e-b761-477a-a848-1b4508adfbdb None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:40.374403 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 398/795] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Sep 27 09:40:40 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:43.155708 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08fe36-ebc2-45dc-9323-cfdcdc38bd92 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:43.156313 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08fe36-ebc2-45dc-9323-cfdcdc38bd92 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:43.156597 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08fe36-ebc2-45dc-9323-cfdcdc38bd92 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:43.159084 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 398/796] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:40:43.165819 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f46443-4f78-48fc-97d2-b1e34f164a6a None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:43.166683 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f46443-4f78-48fc-97d2-b1e34f164a6a None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:43.166882 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f46443-4f78-48fc-97d2-b1e34f164a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:43.189465 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-50f46443-4f78-48fc-97d2-b1e34f164a6a None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:43.190927 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-50f46443-4f78-48fc-97d2-b1e34f164a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:43.283926 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 399/797] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:43 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 09:40:43.512899 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e9fe8-058e-4dfb-90a6-170aa374159e None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:43.513385 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e9fe8-058e-4dfb-90a6-170aa374159e None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:43.513856 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e9fe8-058e-4dfb-90a6-170aa374159e None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:43.516342 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 399/798] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:40:43.524086 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a263d-fc08-4dcb-b194-663f8fb40f66 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:43.524526 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a263d-fc08-4dcb-b194-663f8fb40f66 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:43.524913 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a263d-fc08-4dcb-b194-663f8fb40f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:43.545364 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-952a263d-fc08-4dcb-b194-663f8fb40f66 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:43.546739 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-952a263d-fc08-4dcb-b194-663f8fb40f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:43.612761 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e9fe8-058e-4dfb-90a6-170aa374159e None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:43.646083 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 400/799] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:43 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 09:40:43.731679 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e9fe8-058e-4dfb-90a6-170aa374159e None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:43.768524 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f235a0-c19b-4c07-a26c-1063d89ee419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:43.769076 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f235a0-c19b-4c07-a26c-1063d89ee419 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:43.769342 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f235a0-c19b-4c07-a26c-1063d89ee419 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:43.769602 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f235a0-c19b-4c07-a26c-1063d89ee419 None admin] PATH_INFO: `/v3/services/compute` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:43.770176 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f235a0-c19b-4c07-a26c-1063d89ee419 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:43.772107 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f235a0-c19b-4c07-a26c-1063d89ee419 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:43.781503 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-71f235a0-c19b-4c07-a26c-1063d89ee419 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 09:40:43.781503 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:43.781503 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 09:40:43.781503 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 09:40:43.781503 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 09:40:43.781503 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 09:40:43.781503 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 09:40:43.781503 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:43.781503 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 09:40:43.781503 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:43.781503 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 09:40:43.781503 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:43.781503 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:43.781503 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:43.781503 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:43.781503 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:43.781503 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:43.783563 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:43.783563 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:43.783563 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:43.783563 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:43.783563 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:43.783563 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:43.783563 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 09:40:43.783563 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 09:40:43.783563 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 09:40:43.783563 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 09:40:43.783563 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:43.783563 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:43.783563 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:43.783563 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:43.783563 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:43.783563 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:43.785264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:43.785264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:43.785264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:43.785264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:43.785264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:43.785264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:43.785264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:43.785264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:43.785264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:43.785264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:43.785264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 09:40:43.785264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:43.785264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 09:40:43.785264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:43.785264 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 400/800] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:40:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 09:40:43.790152 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a263d-fc08-4dcb-b194-663f8fb40f66 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:43.830603 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:43.915181 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a263d-fc08-4dcb-b194-663f8fb40f66 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:43.964254 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec245e-bdb0-4c6f-b54c-2ccc9f5aafa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:43.964876 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec245e-bdb0-4c6f-b54c-2ccc9f5aafa2 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:43.965147 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec245e-bdb0-4c6f-b54c-2ccc9f5aafa2 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:43.965412 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec245e-bdb0-4c6f-b54c-2ccc9f5aafa2 None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:43.966048 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec245e-bdb0-4c6f-b54c-2ccc9f5aafa2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:43.966344 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec245e-bdb0-4c6f-b54c-2ccc9f5aafa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:43.967791 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec245e-bdb0-4c6f-b54c-2ccc9f5aafa2 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:43.971393 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f235a0-c19b-4c07-a26c-1063d89ee419 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:43.973746 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 401/801] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Sep 27 09:40:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:43.979632 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec245e-bdb0-4c6f-b54c-2ccc9f5aafa2 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:43.991904 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:44.108931 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f235a0-c19b-4c07-a26c-1063d89ee419 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:44.114010 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:44.128222 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec245e-bdb0-4c6f-b54c-2ccc9f5aafa2 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:44.150407 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d6bdd-00e4-49d5-b333-09c1603f323e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:44.151053 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d6bdd-00e4-49d5-b333-09c1603f323e None admin] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:44.151329 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d6bdd-00e4-49d5-b333-09c1603f323e None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:44.151591 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d6bdd-00e4-49d5-b333-09c1603f323e None admin] PATH_INFO: `/v3/users` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:44.152245 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d6bdd-00e4-49d5-b333-09c1603f323e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:44.153761 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d6bdd-00e4-49d5-b333-09c1603f323e None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:44.171338 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ec2c8-709c-459e-a639-282c2c5967bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:44.172256 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.sql.core [None req-025d6bdd-00e4-49d5-b333-09c1603f323e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 27 09:40:44.172256 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 27 09:40:44.172256 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [parameters: {'user_id': 'f6f27c0ef0944f6f85b4ffe851365172', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 27 09:40:44.172256 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=99839) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 27 09:40:44.173305 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ec2c8-709c-459e-a639-282c2c5967bd None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:44.173305 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ec2c8-709c-459e-a639-282c2c5967bd None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:44.173305 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ec2c8-709c-459e-a639-282c2c5967bd None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:44.174210 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ec2c8-709c-459e-a639-282c2c5967bd None admin] RBAC: Adding query filter params (type=compute) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:44.174704 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ec2c8-709c-459e-a639-282c2c5967bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:44.177327 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ec2c8-709c-459e-a639-282c2c5967bd None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:44.185184 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-025d6bdd-00e4-49d5-b333-09c1603f323e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 27 09:40:44.185184 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:44.185184 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 27 09:40:44.185184 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 27 09:40:44.185184 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 27 09:40:44.185184 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 27 09:40:44.185184 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 27 09:40:44.185184 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application result = self._query(query) Sep 27 09:40:44.185184 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 27 09:40:44.185184 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application conn.query(q) Sep 27 09:40:44.185184 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 27 09:40:44.185184 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 27 09:40:44.185184 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 27 09:40:44.185184 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application result.read() Sep 27 09:40:44.185184 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 27 09:40:44.186290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 27 09:40:44.186290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 27 09:40:44.186290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 27 09:40:44.186290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 27 09:40:44.186290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 27 09:40:44.186290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 27 09:40:44.186290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 27 09:40:44.186290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 27 09:40:44.186290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:44.186290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 27 09:40:44.186290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:44.186290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:44.186290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 27 09:40:44.186290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 27 09:40:44.186290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 27 09:40:44.186290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 27 09:40:44.186290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 27 09:40:44.186290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application next(self.gen) Sep 27 09:40:44.187339 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 27 09:40:44.187339 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application yield resource Sep 27 09:40:44.187339 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 27 09:40:44.187339 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application next(self.gen) Sep 27 09:40:44.187339 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 27 09:40:44.187339 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self.session.rollback() Sep 27 09:40:44.187339 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 09:40:44.187339 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self.force_reraise() Sep 27 09:40:44.187339 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 09:40:44.187339 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise self.value Sep 27 09:40:44.187339 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 27 09:40:44.187339 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 27 09:40:44.187339 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 27 09:40:44.187339 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application session.commit() Sep 27 09:40:44.187339 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 27 09:40:44.187339 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 27 09:40:44.187339 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 27 09:40:44.188944 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self._prepare_impl() Sep 27 09:40:44.188944 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 27 09:40:44.188944 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self.session.flush() Sep 27 09:40:44.188944 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 27 09:40:44.188944 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self._flush(objects) Sep 27 09:40:44.188944 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 27 09:40:44.188944 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 27 09:40:44.188944 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 27 09:40:44.188944 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application compat.raise_( Sep 27 09:40:44.188944 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 27 09:40:44.188944 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception Sep 27 09:40:44.188944 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 27 09:40:44.188944 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application flush_context.execute() Sep 27 09:40:44.188944 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 27 09:40:44.188944 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rec.execute(self) Sep 27 09:40:44.188944 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 27 09:40:44.188944 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 27 09:40:44.191884 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 27 09:40:44.191884 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 27 09:40:44.191884 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 27 09:40:44.191884 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 27 09:40:44.191884 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 27 09:40:44.191884 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 27 09:40:44.191884 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 27 09:40:44.191884 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 27 09:40:44.191884 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 27 09:40:44.191884 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 27 09:40:44.191884 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 27 09:40:44.191884 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 27 09:40:44.191884 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 27 09:40:44.191884 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 27 09:40:44.191884 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 27 09:40:44.191884 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception Sep 27 09:40:44.193762 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 27 09:40:44.193762 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 27 09:40:44.193762 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 27 09:40:44.193762 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 27 09:40:44.193762 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 27 09:40:44.193762 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application result = self._query(query) Sep 27 09:40:44.193762 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 27 09:40:44.193762 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application conn.query(q) Sep 27 09:40:44.193762 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 27 09:40:44.193762 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 27 09:40:44.193762 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 27 09:40:44.193762 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application result.read() Sep 27 09:40:44.193762 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 27 09:40:44.193762 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 27 09:40:44.193762 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 27 09:40:44.193762 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 27 09:40:44.195581 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 27 09:40:44.195581 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 27 09:40:44.195581 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 27 09:40:44.195581 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 27 09:40:44.195581 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 27 09:40:44.195581 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 27 09:40:44.195581 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f6f27c0ef0944f6f85b4ffe851365172', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 27 09:40:44.195581 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 27 09:40:44.195581 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:44.195581 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 09:40:44.195581 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:44.195581 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:44.195581 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:44.195581 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:44.195581 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:44.197174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:44.197174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:44.197174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:44.197174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:44.197174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:44.197174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:44.197174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:44.197174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 27 09:40:44.197174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 27 09:40:44.197174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:44.197174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:44.197174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 09:40:44.197174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:40:44.197174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 09:40:44.197174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:40:44.197174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 27 09:40:44.197174 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 27 09:40:44.198862 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 27 09:40:44.198862 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 27 09:40:44.198862 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 27 09:40:44.198862 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 27 09:40:44.198862 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 27 09:40:44.198862 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:44.199438 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 402/802] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Sep 27 09:40:43 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:40:44.199548 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 401/803] 10.222.0.49 () {60 vars in 1131 bytes} [Tue Sep 27 09:40:43 2022] POST /identity/v3/users => generated 160 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 27 09:40:44.200958 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ec2c8-709c-459e-a639-282c2c5967bd None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:44.343641 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ec2c8-709c-459e-a639-282c2c5967bd None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:44.389267 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfe770-a985-4fd3-a9a8-f1637a3fd4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:44.390267 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfe770-a985-4fd3-a9a8-f1637a3fd4b5 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:44.390603 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfe770-a985-4fd3-a9a8-f1637a3fd4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:44.391053 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfe770-a985-4fd3-a9a8-f1637a3fd4b5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:44.404849 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfe770-a985-4fd3-a9a8-f1637a3fd4b5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:44.407472 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfe770-a985-4fd3-a9a8-f1637a3fd4b5 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:44.430560 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-a1dfe770-a985-4fd3-a9a8-f1637a3fd4b5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 09:40:44.430560 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:44.430560 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:44.430560 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:44.430560 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:44.430560 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:44.430560 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:44.430560 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:44.430560 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:44.430560 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:44.430560 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:44.430560 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:44.430560 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 09:40:44.430560 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 09:40:44.430560 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 09:40:44.430560 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 09:40:44.431886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:44.431886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:44.431886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 09:40:44.431886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:40:44.431886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 09:40:44.431886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:40:44.431886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:44.431886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:44.431886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:44.431886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:44.431886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:44.431886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:44.431886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:44.431886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:44.431886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:44.431886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:44.431886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:44.431886 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:44.433385 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:44.433385 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:44.433385 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 09:40:44.433385 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 09:40:44.433385 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 09:40:44.433385 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 09:40:44.433385 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 09:40:44.433385 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 09:40:44.433385 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 09:40:44.433385 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:44.433385 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 403/804] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:40:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:44.441839 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d6bdd-00e4-49d5-b333-09c1603f323e None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:44.547867 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:44.590002 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d6bdd-00e4-49d5-b333-09c1603f323e None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:44.628781 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c52df-fd22-48f9-b620-809b68b639c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:44.629492 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c52df-fd22-48f9-b620-809b68b639c1 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:44.629904 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c52df-fd22-48f9-b620-809b68b639c1 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:44.631014 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c52df-fd22-48f9-b620-809b68b639c1 None admin] PATH_INFO: `/v3/users` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:44.631185 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c52df-fd22-48f9-b620-809b68b639c1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:44.631544 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c52df-fd22-48f9-b620-809b68b639c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:44.633604 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c52df-fd22-48f9-b620-809b68b639c1 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:44.686902 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 402/805] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Sep 27 09:40:44 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:46.759638 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1fc42-4d02-4c7e-a4fa-6d8e304169b0 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:46.760185 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1fc42-4d02-4c7e-a4fa-6d8e304169b0 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:46.760305 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1fc42-4d02-4c7e-a4fa-6d8e304169b0 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:46.761727 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 404/806] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:40:46.767822 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77c4fc-46db-4db0-a929-a6bb39ffd3bd None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:46.768383 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77c4fc-46db-4db0-a929-a6bb39ffd3bd None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:46.768383 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77c4fc-46db-4db0-a929-a6bb39ffd3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:46.789355 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-8e77c4fc-46db-4db0-a929-a6bb39ffd3bd None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:46.790965 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-8e77c4fc-46db-4db0-a929-a6bb39ffd3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:46.865938 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 403/807] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:46 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 09:40:47.199394 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1fc42-4d02-4c7e-a4fa-6d8e304169b0 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:47.216771 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:47.311939 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1fc42-4d02-4c7e-a4fa-6d8e304169b0 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:47.347371 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561362ea-3916-477b-919c-77bcb0ec026c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:47.348028 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561362ea-3916-477b-919c-77bcb0ec026c None admin] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:47.348357 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561362ea-3916-477b-919c-77bcb0ec026c None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:47.348831 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561362ea-3916-477b-919c-77bcb0ec026c None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:47.349683 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561362ea-3916-477b-919c-77bcb0ec026c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:47.351142 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561362ea-3916-477b-919c-77bcb0ec026c None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:47.369345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 405/808] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Sep 27 09:40:47 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:40:49.859570 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d021a-0985-45c1-807d-2479ee27f80b None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:49.860170 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d021a-0985-45c1-807d-2479ee27f80b None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:49.860170 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d021a-0985-45c1-807d-2479ee27f80b None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:49.861570 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 404/809] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:40:49.868221 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f495fff-e895-4791-8fdb-03b100672a90 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:49.868743 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f495fff-e895-4791-8fdb-03b100672a90 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:49.868743 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f495fff-e895-4791-8fdb-03b100672a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:49.889152 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-3f495fff-e895-4791-8fdb-03b100672a90 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:49.890384 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-3f495fff-e895-4791-8fdb-03b100672a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:49.967836 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:49.974680 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 406/810] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:49 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 09:40:50.311332 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d021a-0985-45c1-807d-2479ee27f80b None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:50.397885 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:50.448460 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d021a-0985-45c1-807d-2479ee27f80b None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:50.492905 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a93a9f-5061-4d83-9505-939e0d73dc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:50.493614 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a93a9f-5061-4d83-9505-939e0d73dc5e None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:50.493936 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a93a9f-5061-4d83-9505-939e0d73dc5e None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:50.494251 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a93a9f-5061-4d83-9505-939e0d73dc5e None admin] PATH_INFO: `/v3/services/compute` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:50.494962 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a93a9f-5061-4d83-9505-939e0d73dc5e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:50.496570 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a93a9f-5061-4d83-9505-939e0d73dc5e None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:50.507310 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-86a93a9f-5061-4d83-9505-939e0d73dc5e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 09:40:50.507310 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:50.507310 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 09:40:50.507310 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 09:40:50.507310 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 09:40:50.507310 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 09:40:50.507310 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 09:40:50.507310 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:50.507310 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 09:40:50.507310 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:50.507310 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 09:40:50.507310 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:50.507310 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:50.507310 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:50.507310 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:50.507310 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:50.507310 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:50.508820 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:50.508820 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:50.508820 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:50.508820 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:50.508820 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:50.508820 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:50.508820 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 09:40:50.508820 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 09:40:50.508820 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 09:40:50.508820 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 09:40:50.508820 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:50.508820 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:50.508820 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:50.508820 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:50.508820 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:50.508820 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:50.509630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:50.509630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:50.509630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:50.509630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:50.509630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:50.509630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:50.509630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:50.509630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:50.509630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:50.509630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:50.509630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 09:40:50.509630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:50.509630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 09:40:50.509630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:40:50.509630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 405/811] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:40:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:50.515057 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f495fff-e895-4791-8fdb-03b100672a90 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:50.633458 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f495fff-e895-4791-8fdb-03b100672a90 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:50.674573 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97903f-ce02-41e0-a513-ebbfddccf35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:50.675339 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97903f-ce02-41e0-a513-ebbfddccf35a None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:50.675612 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97903f-ce02-41e0-a513-ebbfddccf35a None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:50.675878 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97903f-ce02-41e0-a513-ebbfddccf35a None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:50.676522 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97903f-ce02-41e0-a513-ebbfddccf35a None admin] RBAC: Adding query filter params (name=compute) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:50.676884 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97903f-ce02-41e0-a513-ebbfddccf35a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:50.678682 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97903f-ce02-41e0-a513-ebbfddccf35a None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:50.684055 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 407/812] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Sep 27 09:40:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:50.690421 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a93a9f-5061-4d83-9505-939e0d73dc5e None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:50.808449 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a93a9f-5061-4d83-9505-939e0d73dc5e None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:50.841452 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:50.850744 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fbc87-1917-42ac-a730-d48fec0ada89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:50.851393 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fbc87-1917-42ac-a730-d48fec0ada89 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:50.851665 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fbc87-1917-42ac-a730-d48fec0ada89 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:50.851929 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fbc87-1917-42ac-a730-d48fec0ada89 None admin] PATH_INFO: `/v3/services` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:50.852569 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fbc87-1917-42ac-a730-d48fec0ada89 None admin] RBAC: Adding query filter params (type=compute) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:50.852868 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fbc87-1917-42ac-a730-d48fec0ada89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:50.854298 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fbc87-1917-42ac-a730-d48fec0ada89 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:50.860270 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 406/813] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Sep 27 09:40:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:40:50.867340 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97903f-ce02-41e0-a513-ebbfddccf35a None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:50.940012 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:50.981950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97903f-ce02-41e0-a513-ebbfddccf35a None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:51.019885 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f799109-5b7e-489a-bd34-99c384713342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:51.020684 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f799109-5b7e-489a-bd34-99c384713342 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:51.021040 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f799109-5b7e-489a-bd34-99c384713342 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:51.021305 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f799109-5b7e-489a-bd34-99c384713342 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:51.022038 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f799109-5b7e-489a-bd34-99c384713342 None admin] RBAC: Adding query filter params (interface=public, service_id=04b25468eec342c7abd8e81c7e0714af, region_id=RegionOne) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:51.022340 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f799109-5b7e-489a-bd34-99c384713342 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:51.023753 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f799109-5b7e-489a-bd34-99c384713342 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:51.029679 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 408/814] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Sep 27 09:40:50 2022] GET /identity/v3/endpoints?service_id=04b25468eec342c7abd8e81c7e0714af&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:51.035911 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fbc87-1917-42ac-a730-d48fec0ada89 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:51.143629 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fbc87-1917-42ac-a730-d48fec0ada89 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:51.180718 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a302ef-21b8-4fdd-81ff-2cacbc416781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:51.181332 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a302ef-21b8-4fdd-81ff-2cacbc416781 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:51.181611 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a302ef-21b8-4fdd-81ff-2cacbc416781 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:51.181880 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a302ef-21b8-4fdd-81ff-2cacbc416781 None admin] PATH_INFO: `/v3/services` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:51.182486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a302ef-21b8-4fdd-81ff-2cacbc416781 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:51.184063 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a302ef-21b8-4fdd-81ff-2cacbc416781 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:51.191013 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 407/815] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Sep 27 09:40:51 2022] GET /identity/v3/services => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 09:40:53.718563 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587105c-849a-49ce-a40e-63ac484121b5 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:53.719308 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587105c-849a-49ce-a40e-63ac484121b5 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:53.719308 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587105c-849a-49ce-a40e-63ac484121b5 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:53.720677 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 409/816] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:40:53.728339 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150793c-b302-445f-a7ab-60668d0d17f1 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:53.728795 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150793c-b302-445f-a7ab-60668d0d17f1 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:53.728911 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150793c-b302-445f-a7ab-60668d0d17f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:53.752031 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-e150793c-b302-445f-a7ab-60668d0d17f1 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:40:53.753326 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-e150793c-b302-445f-a7ab-60668d0d17f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:40:53.820875 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:53.843926 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 408/817] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:40:53 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 09:40:54.457426 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587105c-849a-49ce-a40e-63ac484121b5 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:54.573971 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587105c-849a-49ce-a40e-63ac484121b5 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:54.604713 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:54.614725 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd133ee2-74d3-4cc2-bfd9-48dc9acd03f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:54.615499 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd133ee2-74d3-4cc2-bfd9-48dc9acd03f7 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:54.615629 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd133ee2-74d3-4cc2-bfd9-48dc9acd03f7 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:54.615858 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd133ee2-74d3-4cc2-bfd9-48dc9acd03f7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:54.616437 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd133ee2-74d3-4cc2-bfd9-48dc9acd03f7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:54.617809 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd133ee2-74d3-4cc2-bfd9-48dc9acd03f7 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:54.627114 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-cd133ee2-74d3-4cc2-bfd9-48dc9acd03f7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 09:40:54.627114 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:54.627114 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 09:40:54.627114 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 09:40:54.627114 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 09:40:54.627114 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 09:40:54.627114 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 09:40:54.627114 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:54.627114 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 09:40:54.627114 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:54.627114 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 09:40:54.627114 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:54.627114 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:40:54.627114 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:40:54.627114 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:40:54.627114 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:40:54.627114 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:40:54.628762 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:40:54.628762 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:40:54.628762 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:40:54.628762 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:40:54.628762 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:40:54.628762 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:40:54.628762 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 09:40:54.628762 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 09:40:54.628762 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 09:40:54.628762 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 09:40:54.628762 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:40:54.628762 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:40:54.628762 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:40:54.628762 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:40:54.628762 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:40:54.628762 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:40:54.629674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:40:54.629674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:40:54.629674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:40:54.629674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:40:54.629674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:40:54.629674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:40:54.629674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:40:54.629674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:40:54.629674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:40:54.629674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:40:54.629674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 09:40:54.629674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:40:54.629674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 09:40:54.629674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:40:54.629674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 410/818] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:40:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:40:54.637464 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150793c-b302-445f-a7ab-60668d0d17f1 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:54.749468 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150793c-b302-445f-a7ab-60668d0d17f1 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:54.785124 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b193c9-415f-4960-b8a6-d7d3e76a6d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:54.785732 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b193c9-415f-4960-b8a6-d7d3e76a6d87 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:54.786000 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b193c9-415f-4960-b8a6-d7d3e76a6d87 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:54.786353 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b193c9-415f-4960-b8a6-d7d3e76a6d87 None admin] PATH_INFO: `/v3/services` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:54.787199 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b193c9-415f-4960-b8a6-d7d3e76a6d87 None admin] RBAC: Adding query filter params (name=compute) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:54.787512 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b193c9-415f-4960-b8a6-d7d3e76a6d87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:54.789229 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b193c9-415f-4960-b8a6-d7d3e76a6d87 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:54.794422 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 409/819] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Sep 27 09:40:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:54.800560 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd133ee2-74d3-4cc2-bfd9-48dc9acd03f7 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:54.910600 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd133ee2-74d3-4cc2-bfd9-48dc9acd03f7 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:54.949188 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc9ad7-6b0f-451f-a443-d1fc9d7bb5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:54.949812 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc9ad7-6b0f-451f-a443-d1fc9d7bb5d8 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:54.950084 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc9ad7-6b0f-451f-a443-d1fc9d7bb5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:54.950349 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc9ad7-6b0f-451f-a443-d1fc9d7bb5d8 None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:54.951043 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc9ad7-6b0f-451f-a443-d1fc9d7bb5d8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:40:54.951339 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc9ad7-6b0f-451f-a443-d1fc9d7bb5d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:54.952739 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc9ad7-6b0f-451f-a443-d1fc9d7bb5d8 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:54.958260 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 411/820] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Sep 27 09:40:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:40:54.964652 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b193c9-415f-4960-b8a6-d7d3e76a6d87 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:40:55.019130 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:40:55.071327 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b193c9-415f-4960-b8a6-d7d3e76a6d87 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:40:55.123027 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eead1d2-b48f-4c63-8802-cb2fc81d815a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:40:55.124070 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eead1d2-b48f-4c63-8802-cb2fc81d815a None admin] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:40:55.124354 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eead1d2-b48f-4c63-8802-cb2fc81d815a None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:40:55.124650 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eead1d2-b48f-4c63-8802-cb2fc81d815a None admin] PATH_INFO: `/v3/endpoints` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:40:55.125330 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eead1d2-b48f-4c63-8802-cb2fc81d815a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:40:55.126754 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eead1d2-b48f-4c63-8802-cb2fc81d815a None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:40:55.150508 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 410/821] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 27 09:40:54 2022] POST /identity/v3/endpoints => generated 334 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:41:04.955651 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=72 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:41:05.145143 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=46,keystone:INSERT=1 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:01.316335 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e18170-6c03-45b6-b584-4867ff6ab67c None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:01.318010 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e18170-6c03-45b6-b584-4867ff6ab67c None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:01.318010 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e18170-6c03-45b6-b584-4867ff6ab67c None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:01.318377 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 412/822] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:42:01.330063 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5683dab-af16-41c1-a31e-b1538a3ef447 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:01.331192 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5683dab-af16-41c1-a31e-b1538a3ef447 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:01.331192 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5683dab-af16-41c1-a31e-b1538a3ef447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:01.351015 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-e5683dab-af16-41c1-a31e-b1538a3ef447 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:42:01.352231 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-e5683dab-af16-41c1-a31e-b1538a3ef447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:42:01.442037 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 411/823] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:42:01 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 09:42:01.822374 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e18170-6c03-45b6-b584-4867ff6ab67c None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:01.950943 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e18170-6c03-45b6-b584-4867ff6ab67c None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:01.999830 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0489f-81e0-43f0-9e7e-6fb502f9ef94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:02.000936 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0489f-81e0-43f0-9e7e-6fb502f9ef94 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:02.001441 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0489f-81e0-43f0-9e7e-6fb502f9ef94 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:02.001746 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0489f-81e0-43f0-9e7e-6fb502f9ef94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:02.015574 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0489f-81e0-43f0-9e7e-6fb502f9ef94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:02.017336 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0489f-81e0-43f0-9e7e-6fb502f9ef94 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:02.036777 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-06a0489f-81e0-43f0-9e7e-6fb502f9ef94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:42:02.036777 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:02.036777 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:02.036777 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:02.036777 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:02.036777 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:02.036777 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:02.036777 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:02.036777 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:02.036777 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:02.036777 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:02.036777 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:02.036777 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:42:02.036777 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:42:02.036777 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:42:02.036777 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:42:02.037943 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:02.037943 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:02.037943 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:02.037943 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:02.037943 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:02.037943 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:02.037943 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:02.037943 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:02.037943 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:02.037943 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:02.037943 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:02.037943 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:02.037943 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:02.037943 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:02.037943 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:02.037943 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:02.037943 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:42:02.039422 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:42:02.039422 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:42:02.039422 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:42:02.042998 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 413/824] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:02.045704 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5683dab-af16-41c1-a31e-b1538a3ef447 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:02.185018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5683dab-af16-41c1-a31e-b1538a3ef447 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:02.223091 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:02.237266 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f091c34-f155-4a46-b5b0-208489e907d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:02.240871 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f091c34-f155-4a46-b5b0-208489e907d7 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:02.241156 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f091c34-f155-4a46-b5b0-208489e907d7 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:02.241504 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f091c34-f155-4a46-b5b0-208489e907d7 None admin] PATH_INFO: `/v3/domains` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:02.242218 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f091c34-f155-4a46-b5b0-208489e907d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:02.242512 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f091c34-f155-4a46-b5b0-208489e907d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:02.244226 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f091c34-f155-4a46-b5b0-208489e907d7 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:02.262988 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 412/825] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:02.266314 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0489f-81e0-43f0-9e7e-6fb502f9ef94 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:02.334016 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:02.390197 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0489f-81e0-43f0-9e7e-6fb502f9ef94 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:02.430548 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162218a1-15a4-4f40-b366-d54bd7683966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:02.431265 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162218a1-15a4-4f40-b366-d54bd7683966 None admin] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:02.432311 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162218a1-15a4-4f40-b366-d54bd7683966 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:02.432311 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162218a1-15a4-4f40-b366-d54bd7683966 None admin] PATH_INFO: `/v3/users` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:02.432512 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162218a1-15a4-4f40-b366-d54bd7683966 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:02.433934 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162218a1-15a4-4f40-b366-d54bd7683966 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:02.462685 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 414/826] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Sep 27 09:42:02 2022] POST /identity/v3/users => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:42:04.998412 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ed4c7-71a4-43dc-929a-c7c9db57c2b3 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:04.999077 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ed4c7-71a4-43dc-929a-c7c9db57c2b3 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:04.999077 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ed4c7-71a4-43dc-929a-c7c9db57c2b3 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:05.000256 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 413/827] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:42:05.006475 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af39c23-2ad1-4e43-86d0-1fa337c7adb0 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:05.007027 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af39c23-2ad1-4e43-86d0-1fa337c7adb0 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:05.007027 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af39c23-2ad1-4e43-86d0-1fa337c7adb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:05.028660 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-6af39c23-2ad1-4e43-86d0-1fa337c7adb0 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:42:05.030105 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-6af39c23-2ad1-4e43-86d0-1fa337c7adb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:42:05.107960 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 415/828] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:42:05 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 09:42:05.443292 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ed4c7-71a4-43dc-929a-c7c9db57c2b3 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:05.567208 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ed4c7-71a4-43dc-929a-c7c9db57c2b3 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:05.612919 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d9dba-b0dc-4150-b91c-816768bc10d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:05.613637 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d9dba-b0dc-4150-b91c-816768bc10d9 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:05.614007 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d9dba-b0dc-4150-b91c-816768bc10d9 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:05.614266 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d9dba-b0dc-4150-b91c-816768bc10d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:05.625738 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d9dba-b0dc-4150-b91c-816768bc10d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:42:05.630789 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-bc4d9dba-b0dc-4150-b91c-816768bc10d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:42:05.630789 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:05.630789 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:05.630789 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:05.630789 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:05.630789 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:05.630789 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:05.630789 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:05.630789 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:05.630789 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:05.630789 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:05.630789 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:05.630789 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:42:05.630789 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:42:05.630789 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:42:05.630789 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:42:05.631806 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:42:05.631806 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:42:05.631806 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:42:05.631806 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:42:05.631806 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:05.631806 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:05.631806 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:05.631806 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:05.631806 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:05.631806 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:05.631806 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:05.631806 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:05.631806 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:05.631806 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:05.631806 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:05.631806 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:05.632775 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:05.632775 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:05.632775 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:05.632775 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:05.632775 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:42:05.632775 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:42:05.632775 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:42:05.632775 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:42:05.632775 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:42:05.632775 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:42:05.632775 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:42:05.632775 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:42:05.632775 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 414/829] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 27 09:42:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:05.638187 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af39c23-2ad1-4e43-86d0-1fa337c7adb0 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:05.682388 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:05.744672 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af39c23-2ad1-4e43-86d0-1fa337c7adb0 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:05.780016 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7469160-5153-47ae-99f5-53cc0d0ea93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:05.780801 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7469160-5153-47ae-99f5-53cc0d0ea93c None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:05.781072 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7469160-5153-47ae-99f5-53cc0d0ea93c None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:05.781338 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7469160-5153-47ae-99f5-53cc0d0ea93c None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:05.782012 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7469160-5153-47ae-99f5-53cc0d0ea93c None admin] RBAC: Adding query filter params (name=service) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:05.782308 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7469160-5153-47ae-99f5-53cc0d0ea93c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:05.783752 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7469160-5153-47ae-99f5-53cc0d0ea93c None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:05.793776 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 416/830] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 27 09:42:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:05.800248 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d9dba-b0dc-4150-b91c-816768bc10d9 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:05.849282 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:05.915109 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d9dba-b0dc-4150-b91c-816768bc10d9 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:05.954163 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5329a-1fdb-4fc1-a0aa-2226e5bdc504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:05.954811 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5329a-1fdb-4fc1-a0aa-2226e5bdc504 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:05.955137 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5329a-1fdb-4fc1-a0aa-2226e5bdc504 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:05.955472 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5329a-1fdb-4fc1-a0aa-2226e5bdc504 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:05.967238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5329a-1fdb-4fc1-a0aa-2226e5bdc504 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:05.968832 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5329a-1fdb-4fc1-a0aa-2226e5bdc504 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:05.985061 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-49a5329a-1fdb-4fc1-a0aa-2226e5bdc504 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:42:05.985061 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:05.985061 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:05.985061 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:05.985061 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:05.985061 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:05.985061 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:05.985061 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:05.985061 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:05.985061 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:05.985061 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:05.985061 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:05.985061 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:42:05.985061 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:42:05.985061 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:42:05.985061 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:42:05.986259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:05.986259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:05.986259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:05.986259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:05.986259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:05.986259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:05.986259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:05.986259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:05.986259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:05.986259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:05.986259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:05.986259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:05.986259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:05.986259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:05.986259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:05.986259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:05.986259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:42:05.987536 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:42:05.987536 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:42:05.987536 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:42:05.987536 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 415/831] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:05.992497 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7469160-5153-47ae-99f5-53cc0d0ea93c None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:06.098812 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:06.102948 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7469160-5153-47ae-99f5-53cc0d0ea93c None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:06.142115 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5def9-96ff-4064-9db7-d2fa5bb7f90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:06.142737 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5def9-96ff-4064-9db7-d2fa5bb7f90a None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:06.143043 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5def9-96ff-4064-9db7-d2fa5bb7f90a None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:06.143374 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5def9-96ff-4064-9db7-d2fa5bb7f90a None admin] PATH_INFO: `/v3/domains` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:06.143991 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5def9-96ff-4064-9db7-d2fa5bb7f90a None admin] RBAC: Adding query filter params (name=Default) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:06.144340 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5def9-96ff-4064-9db7-d2fa5bb7f90a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:06.145869 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5def9-96ff-4064-9db7-d2fa5bb7f90a None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:06.159879 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 417/832] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:42:06.166262 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5329a-1fdb-4fc1-a0aa-2226e5bdc504 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:06.271702 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:06.276101 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5329a-1fdb-4fc1-a0aa-2226e5bdc504 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:06.316707 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0393e-ee9b-4935-9fb9-9730aacb387e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:06.317569 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0393e-ee9b-4935-9fb9-9730aacb387e None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:06.317809 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0393e-ee9b-4935-9fb9-9730aacb387e None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:06.318163 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0393e-ee9b-4935-9fb9-9730aacb387e None admin] PATH_INFO: `/v3/users/placement` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:06.327930 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0393e-ee9b-4935-9fb9-9730aacb387e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:06.329688 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0393e-ee9b-4935-9fb9-9730aacb387e None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:06.342139 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-08c0393e-ee9b-4935-9fb9-9730aacb387e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 09:42:06.342139 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:06.342139 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:06.342139 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:06.342139 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:06.342139 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:06.342139 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:06.342139 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:06.342139 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:06.342139 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:06.342139 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:06.342139 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:06.342139 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 09:42:06.342139 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 09:42:06.342139 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 09:42:06.342139 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 09:42:06.343322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:06.343322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:06.343322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 09:42:06.343322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:42:06.343322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 09:42:06.343322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:42:06.343322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:06.343322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:06.343322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:06.343322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:06.343322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:06.343322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:06.343322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:06.343322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:06.343322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:06.343322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:06.343322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:06.343322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:06.344259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:06.344259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:06.344259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 09:42:06.344259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 09:42:06.344259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 09:42:06.344259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 09:42:06.344259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 09:42:06.344259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 09:42:06.344259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 27 09:42:06.344259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:42:06.344259 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 416/833] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:42:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:06.349758 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5def9-96ff-4064-9db7-d2fa5bb7f90a None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:06.472621 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5def9-96ff-4064-9db7-d2fa5bb7f90a None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:06.511637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b39da-c077-45e0-8470-9a49ca015c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:06.512309 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b39da-c077-45e0-8470-9a49ca015c5e None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:06.512706 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b39da-c077-45e0-8470-9a49ca015c5e None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:06.513007 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b39da-c077-45e0-8470-9a49ca015c5e None admin] PATH_INFO: `/v3/users` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:06.513909 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b39da-c077-45e0-8470-9a49ca015c5e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:06.514273 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b39da-c077-45e0-8470-9a49ca015c5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:06.516190 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b39da-c077-45e0-8470-9a49ca015c5e None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:06.536145 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 418/834] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Sep 27 09:42:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:06.542603 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0393e-ee9b-4935-9fb9-9730aacb387e None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:06.670872 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0393e-ee9b-4935-9fb9-9730aacb387e None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:06.708281 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b54e0-fef7-4d69-afc6-e790a1a69b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:06.708904 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b54e0-fef7-4d69-afc6-e790a1a69b97 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:06.709182 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b54e0-fef7-4d69-afc6-e790a1a69b97 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:06.709506 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b54e0-fef7-4d69-afc6-e790a1a69b97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:06.738131 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:06.785162 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b54e0-fef7-4d69-afc6-e790a1a69b97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:06.787043 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b54e0-fef7-4d69-afc6-e790a1a69b97 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:06.900342 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 417/835] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:42:06 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 09:42:06.906394 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b39da-c077-45e0-8470-9a49ca015c5e None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:06.926676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:07.016543 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b39da-c077-45e0-8470-9a49ca015c5e None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:07.053922 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc83531-da2a-44c3-8a58-349c52ed51e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:07.054561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc83531-da2a-44c3-8a58-349c52ed51e5 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:07.054889 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc83531-da2a-44c3-8a58-349c52ed51e5 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:07.055166 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc83531-da2a-44c3-8a58-349c52ed51e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:07.065738 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc83531-da2a-44c3-8a58-349c52ed51e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:07.068008 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc83531-da2a-44c3-8a58-349c52ed51e5 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:07.090577 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-8cc83531-da2a-44c3-8a58-349c52ed51e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:42:07.090577 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:07.090577 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:07.090577 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:07.090577 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:07.090577 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:07.090577 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:07.090577 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:07.090577 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:07.090577 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:07.090577 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:07.090577 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:07.090577 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:42:07.090577 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:42:07.090577 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:42:07.090577 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:42:07.092185 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:07.092185 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:07.092185 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:07.092185 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:07.092185 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:07.092185 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:07.092185 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:07.092185 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:07.092185 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:07.092185 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:07.092185 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:07.092185 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:07.092185 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:07.092185 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:07.092185 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:07.092185 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:07.092185 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:42:07.093551 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:42:07.093551 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:42:07.093551 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:42:07.093551 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 419/836] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 09:42:07.098001 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b54e0-fef7-4d69-afc6-e790a1a69b97 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:07.161997 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:07.209246 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b54e0-fef7-4d69-afc6-e790a1a69b97 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:07.245378 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e29e3-c48a-4646-b819-e5a375962fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:07.245992 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e29e3-c48a-4646-b819-e5a375962fca None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:07.246473 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e29e3-c48a-4646-b819-e5a375962fca None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:07.246746 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e29e3-c48a-4646-b819-e5a375962fca None admin] PATH_INFO: `/v3/domains` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:07.247419 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e29e3-c48a-4646-b819-e5a375962fca None admin] RBAC: Adding query filter params (name=Default) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:07.247722 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e29e3-c48a-4646-b819-e5a375962fca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:07.249097 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e29e3-c48a-4646-b819-e5a375962fca None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:07.260999 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 418/837] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:07.266714 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc83531-da2a-44c3-8a58-349c52ed51e5 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:07.347233 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:07.385328 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc83531-da2a-44c3-8a58-349c52ed51e5 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:07.423469 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf9ce2-b058-44a9-a8fa-aadfc8460464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:07.424113 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf9ce2-b058-44a9-a8fa-aadfc8460464 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:07.424416 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf9ce2-b058-44a9-a8fa-aadfc8460464 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:07.424674 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf9ce2-b058-44a9-a8fa-aadfc8460464 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:07.436004 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf9ce2-b058-44a9-a8fa-aadfc8460464 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:07.437582 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf9ce2-b058-44a9-a8fa-aadfc8460464 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:07.449975 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-1aaf9ce2-b058-44a9-a8fa-aadfc8460464 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:42:07.449975 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:07.449975 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:07.449975 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:07.449975 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:07.449975 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:07.449975 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:07.449975 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:07.449975 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:07.449975 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:07.449975 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:07.449975 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:07.449975 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 09:42:07.449975 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 09:42:07.449975 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 09:42:07.452368 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 09:42:07.452368 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:07.452368 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:07.452368 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:07.452368 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:07.452368 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:07.452368 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:07.452368 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:07.452368 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:07.452368 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:07.452368 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:07.452368 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:07.452368 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:07.452368 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:07.452368 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:07.452368 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:07.452368 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:07.454446 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 09:42:07.454446 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 09:42:07.454446 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 09:42:07.454446 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 09:42:07.454446 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 09:42:07.454446 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 09:42:07.454446 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:42:07.454446 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:42:07.454446 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 420/838] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:42:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:07.465075 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e29e3-c48a-4646-b819-e5a375962fca None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:07.572161 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e29e3-c48a-4646-b819-e5a375962fca None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:07.590978 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:07.610640 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9664735-48c2-4ba4-87ee-63a5ed1e3128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:07.611384 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9664735-48c2-4ba4-87ee-63a5ed1e3128 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:07.611668 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9664735-48c2-4ba4-87ee-63a5ed1e3128 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:07.611941 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9664735-48c2-4ba4-87ee-63a5ed1e3128 None admin] PATH_INFO: `/v3/projects` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:07.612631 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9664735-48c2-4ba4-87ee-63a5ed1e3128 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:07.612942 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9664735-48c2-4ba4-87ee-63a5ed1e3128 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:07.614521 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9664735-48c2-4ba4-87ee-63a5ed1e3128 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:07.627272 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 419/839] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 27 09:42:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:07.634018 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf9ce2-b058-44a9-a8fa-aadfc8460464 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:07.740114 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf9ce2-b058-44a9-a8fa-aadfc8460464 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:07.769866 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:07.776293 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf57c1b-a87c-4bb1-a55e-bffb1f152737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:07.790120 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf57c1b-a87c-4bb1-a55e-bffb1f152737 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:07.790403 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf57c1b-a87c-4bb1-a55e-bffb1f152737 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:07.790640 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf57c1b-a87c-4bb1-a55e-bffb1f152737 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:07.791424 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf57c1b-a87c-4bb1-a55e-bffb1f152737 None admin] RBAC: Adding query filter params (role.id=a3ad332ff078405ebc48aa8df0035cab, scope.project.id=dbe5c492b05e40448942bb2500c185ee, user.id=8d7d537583c64b5cabe287be6875a478) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:07.791738 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf57c1b-a87c-4bb1-a55e-bffb1f152737 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:07.793315 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf57c1b-a87c-4bb1-a55e-bffb1f152737 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:07.804920 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 421/840] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:42:07 2022] GET /identity/v3/role_assignments?user.id=8d7d537583c64b5cabe287be6875a478&scope.project.id=dbe5c492b05e40448942bb2500c185ee&role.id=a3ad332ff078405ebc48aa8df0035cab => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:10.278292 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaaefa-7436-454d-9c8e-709a1d8adaa6 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:10.278953 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaaefa-7436-454d-9c8e-709a1d8adaa6 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:10.278953 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaaefa-7436-454d-9c8e-709a1d8adaa6 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:10.280365 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 420/841] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:42:10.286401 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489105b0-b2a2-48c7-8184-6e0f0ea79da1 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:10.287031 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489105b0-b2a2-48c7-8184-6e0f0ea79da1 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:10.287031 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489105b0-b2a2-48c7-8184-6e0f0ea79da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:10.308929 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-489105b0-b2a2-48c7-8184-6e0f0ea79da1 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:42:10.310327 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-489105b0-b2a2-48c7-8184-6e0f0ea79da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:42:10.388875 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 422/842] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:42:10 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 09:42:10.717553 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaaaefa-7436-454d-9c8e-709a1d8adaa6 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:10.832479 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaaaefa-7436-454d-9c8e-709a1d8adaa6 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:10.873309 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b6e4b-2ef4-4dbb-b0ca-d4ba674188e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:10.873919 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b6e4b-2ef4-4dbb-b0ca-d4ba674188e4 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:10.874214 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b6e4b-2ef4-4dbb-b0ca-d4ba674188e4 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:10.874482 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b6e4b-2ef4-4dbb-b0ca-d4ba674188e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:10.887146 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b6e4b-2ef4-4dbb-b0ca-d4ba674188e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:42:10.892404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-a94b6e4b-2ef4-4dbb-b0ca-d4ba674188e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:42:10.892404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:10.892404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:10.892404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:10.892404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:10.892404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:10.892404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:10.892404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:10.892404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:10.892404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:10.892404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:10.892404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:10.892404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:42:10.892404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:42:10.892404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:42:10.892404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:42:10.893486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:42:10.893486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:42:10.893486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:42:10.893486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:42:10.893486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:10.893486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:10.893486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:10.893486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:10.893486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:10.893486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:10.893486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:10.893486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:10.893486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:10.893486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:10.893486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:10.893486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:10.894432 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:10.894432 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:10.894432 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:10.894432 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:10.894432 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:42:10.894432 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:42:10.894432 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:42:10.894432 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:42:10.894432 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:42:10.894432 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:42:10.894432 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:42:10.894432 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:42:10.894432 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 421/843] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 27 09:42:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:10.900665 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489105b0-b2a2-48c7-8184-6e0f0ea79da1 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:11.011918 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489105b0-b2a2-48c7-8184-6e0f0ea79da1 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:11.039623 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:11.051731 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cfc02-af92-4af1-af40-6f660b6234fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:11.052168 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cfc02-af92-4af1-af40-6f660b6234fc None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:11.052459 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cfc02-af92-4af1-af40-6f660b6234fc None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:11.052722 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cfc02-af92-4af1-af40-6f660b6234fc None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:11.053441 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cfc02-af92-4af1-af40-6f660b6234fc None admin] RBAC: Adding query filter params (name=service) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:11.053748 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cfc02-af92-4af1-af40-6f660b6234fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:11.055312 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cfc02-af92-4af1-af40-6f660b6234fc None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:11.064728 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 423/844] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 27 09:42:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:11.071155 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b6e4b-2ef4-4dbb-b0ca-d4ba674188e4 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:11.118635 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:11.196547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b6e4b-2ef4-4dbb-b0ca-d4ba674188e4 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:11.235952 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad895061-cf5d-453c-ab75-7aff67285495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:11.236602 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad895061-cf5d-453c-ab75-7aff67285495 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:11.236877 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad895061-cf5d-453c-ab75-7aff67285495 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:11.237146 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad895061-cf5d-453c-ab75-7aff67285495 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:11.248184 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad895061-cf5d-453c-ab75-7aff67285495 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:11.249654 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad895061-cf5d-453c-ab75-7aff67285495 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:11.266666 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-ad895061-cf5d-453c-ab75-7aff67285495 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:42:11.266666 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:11.266666 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:11.266666 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:11.266666 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:11.266666 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:11.266666 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:11.266666 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:11.266666 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:11.266666 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:11.266666 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:11.266666 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:11.266666 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:42:11.266666 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:42:11.266666 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:42:11.266666 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:42:11.268322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:11.268322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:11.268322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:11.268322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:11.268322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:11.268322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:11.268322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:11.268322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:11.268322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:11.268322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:11.268322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:11.268322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:11.268322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:11.268322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:11.268322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:11.268322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:11.268322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:42:11.269682 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:42:11.269682 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:42:11.269682 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:42:11.269682 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 422/845] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:11.275547 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cfc02-af92-4af1-af40-6f660b6234fc None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:11.408090 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cfc02-af92-4af1-af40-6f660b6234fc None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:11.466200 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c8162-f5c6-44d3-b077-4e68ce73eb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:11.467119 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c8162-f5c6-44d3-b077-4e68ce73eb50 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:11.467597 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c8162-f5c6-44d3-b077-4e68ce73eb50 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:11.468083 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c8162-f5c6-44d3-b077-4e68ce73eb50 None admin] PATH_INFO: `/v3/domains` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:11.469231 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c8162-f5c6-44d3-b077-4e68ce73eb50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:11.469755 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c8162-f5c6-44d3-b077-4e68ce73eb50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:11.472264 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c8162-f5c6-44d3-b077-4e68ce73eb50 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:11.493720 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 424/846] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:11.501009 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad895061-cf5d-453c-ab75-7aff67285495 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:11.615704 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:11.626833 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad895061-cf5d-453c-ab75-7aff67285495 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:11.675826 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459470d-7671-4e5c-b4d2-fd339e7c17f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:11.677215 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459470d-7671-4e5c-b4d2-fd339e7c17f2 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:11.677514 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459470d-7671-4e5c-b4d2-fd339e7c17f2 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:11.677765 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459470d-7671-4e5c-b4d2-fd339e7c17f2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:11.686070 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459470d-7671-4e5c-b4d2-fd339e7c17f2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:11.687569 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459470d-7671-4e5c-b4d2-fd339e7c17f2 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:11.706451 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-b459470d-7671-4e5c-b4d2-fd339e7c17f2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 09:42:11.706451 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:11.706451 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:11.706451 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:11.706451 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:11.706451 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:11.706451 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:11.706451 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:11.706451 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:11.706451 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:11.706451 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:11.706451 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:11.706451 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 09:42:11.706451 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 09:42:11.706451 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 09:42:11.706451 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 09:42:11.708441 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:11.708441 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:11.708441 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 09:42:11.708441 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:42:11.708441 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 09:42:11.708441 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:42:11.708441 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:11.708441 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:11.708441 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:11.708441 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:11.708441 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:11.708441 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:11.708441 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:11.708441 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:11.708441 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:11.708441 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:11.708441 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:11.708441 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:11.709420 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:11.709420 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:11.709420 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 09:42:11.709420 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 09:42:11.709420 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 09:42:11.709420 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 09:42:11.709420 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 09:42:11.709420 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 09:42:11.709420 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 27 09:42:11.709420 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:42:11.709420 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 423/847] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:42:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:11.710001 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c8162-f5c6-44d3-b077-4e68ce73eb50 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:11.765957 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:11.828284 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c8162-f5c6-44d3-b077-4e68ce73eb50 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:11.869371 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176a0e4-97e0-4549-8609-bab1a5f3610a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:11.870037 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176a0e4-97e0-4549-8609-bab1a5f3610a None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:11.870360 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176a0e4-97e0-4549-8609-bab1a5f3610a None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:11.870633 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176a0e4-97e0-4549-8609-bab1a5f3610a None admin] PATH_INFO: `/v3/users` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:11.871402 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5176a0e4-97e0-4549-8609-bab1a5f3610a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:11.871748 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5176a0e4-97e0-4549-8609-bab1a5f3610a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:11.873208 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5176a0e4-97e0-4549-8609-bab1a5f3610a None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:11.892608 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 425/848] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Sep 27 09:42:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:11.899199 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459470d-7671-4e5c-b4d2-fd339e7c17f2 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:12.028930 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459470d-7671-4e5c-b4d2-fd339e7c17f2 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:12.064525 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7c91f-61a6-4453-85ad-93be67f1d9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:12.065231 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7c91f-61a6-4453-85ad-93be67f1d9e2 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:12.065422 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7c91f-61a6-4453-85ad-93be67f1d9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:12.065706 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7c91f-61a6-4453-85ad-93be67f1d9e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:12.077990 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7c91f-61a6-4453-85ad-93be67f1d9e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:12.079493 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7c91f-61a6-4453-85ad-93be67f1d9e2 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:12.094290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-0bc7c91f-61a6-4453-85ad-93be67f1d9e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:42:12.094290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:12.094290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:12.094290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:12.094290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:12.094290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:12.094290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:12.094290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:12.094290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:12.094290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:12.094290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:12.094290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:12.094290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:42:12.094290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:42:12.094290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:42:12.094290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:42:12.095701 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:12.095701 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:12.095701 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:12.095701 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:12.095701 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:12.095701 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:12.095701 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:12.095701 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:12.095701 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:12.095701 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:12.095701 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:12.095701 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:12.095701 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:12.095701 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:12.095701 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:12.095701 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:12.095701 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:42:12.096653 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:42:12.096653 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:42:12.096653 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:42:12.096653 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 424/849] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:12.101571 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176a0e4-97e0-4549-8609-bab1a5f3610a None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:12.221247 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176a0e4-97e0-4549-8609-bab1a5f3610a None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:12.223946 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:12.257776 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a7bb9-aa35-4aff-9d5b-8e63b72caae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:12.258418 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a7bb9-aa35-4aff-9d5b-8e63b72caae1 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:12.258693 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a7bb9-aa35-4aff-9d5b-8e63b72caae1 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:12.259009 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a7bb9-aa35-4aff-9d5b-8e63b72caae1 None admin] PATH_INFO: `/v3/domains` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:12.259660 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a7bb9-aa35-4aff-9d5b-8e63b72caae1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:12.259957 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a7bb9-aa35-4aff-9d5b-8e63b72caae1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:12.261759 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a7bb9-aa35-4aff-9d5b-8e63b72caae1 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:12.275086 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 426/850] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:12.281301 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7c91f-61a6-4453-85ad-93be67f1d9e2 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:12.286340 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:12.413611 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7c91f-61a6-4453-85ad-93be67f1d9e2 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:12.458728 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999415ec-75be-4d07-9154-78addd791f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:12.459270 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999415ec-75be-4d07-9154-78addd791f95 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:12.459555 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999415ec-75be-4d07-9154-78addd791f95 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:12.459850 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999415ec-75be-4d07-9154-78addd791f95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:12.467478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999415ec-75be-4d07-9154-78addd791f95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:12.469121 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999415ec-75be-4d07-9154-78addd791f95 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:12.483158 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-999415ec-75be-4d07-9154-78addd791f95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:42:12.483158 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:12.483158 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:12.483158 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:12.483158 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:12.483158 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:12.483158 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:12.483158 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:12.483158 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:12.483158 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:12.483158 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:12.483158 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:12.483158 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 09:42:12.483158 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 09:42:12.483158 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 09:42:12.484647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 09:42:12.484647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:12.484647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:12.484647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:12.484647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:12.484647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:12.484647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:12.484647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:12.484647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:12.484647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:12.484647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:12.484647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:12.484647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:12.484647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:12.484647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:12.484647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:12.484647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:12.485523 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 09:42:12.485523 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 09:42:12.485523 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 09:42:12.485523 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 09:42:12.485523 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 09:42:12.485523 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 09:42:12.485523 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:42:12.485523 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:42:12.485523 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 425/851] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:42:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:12.490653 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a7bb9-aa35-4aff-9d5b-8e63b72caae1 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:12.620621 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a7bb9-aa35-4aff-9d5b-8e63b72caae1 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:12.662488 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584ce16-1dd0-4e4d-9306-5c088e75da42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:12.663264 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584ce16-1dd0-4e4d-9306-5c088e75da42 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:12.663618 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584ce16-1dd0-4e4d-9306-5c088e75da42 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:12.664312 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584ce16-1dd0-4e4d-9306-5c088e75da42 None admin] PATH_INFO: `/v3/projects` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:12.665086 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584ce16-1dd0-4e4d-9306-5c088e75da42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:12.665399 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584ce16-1dd0-4e4d-9306-5c088e75da42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:12.666946 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584ce16-1dd0-4e4d-9306-5c088e75da42 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:12.681704 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 427/852] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 27 09:42:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:12.688350 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999415ec-75be-4d07-9154-78addd791f95 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:12.756873 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:12.804644 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999415ec-75be-4d07-9154-78addd791f95 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:12.839707 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7893582-40ca-44fd-af1f-bb7d520b7336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:12.840286 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7893582-40ca-44fd-af1f-bb7d520b7336 None admin] REQUEST_METHOD: `PUT` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:12.840560 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7893582-40ca-44fd-af1f-bb7d520b7336 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:12.840814 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7893582-40ca-44fd-af1f-bb7d520b7336 None admin] PATH_INFO: `/v3/projects/dbe5c492b05e40448942bb2500c185ee/users/8d7d537583c64b5cabe287be6875a478/roles/a3ad332ff078405ebc48aa8df0035cab` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:12.857179 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7893582-40ca-44fd-af1f-bb7d520b7336 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbe5c492b05e40448942bb2500c185ee, user_id=8d7d537583c64b5cabe287be6875a478, role_id=a3ad332ff078405ebc48aa8df0035cab)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:12.858619 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7893582-40ca-44fd-af1f-bb7d520b7336 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:12.874717 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 426/853] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 27 09:42:12 2022] PUT /identity/v3/projects/dbe5c492b05e40448942bb2500c185ee/users/8d7d537583c64b5cabe287be6875a478/roles/a3ad332ff078405ebc48aa8df0035cab => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 09:42:15.272670 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5cf80-96f2-4fb8-b8dc-7763509a5add None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:15.273233 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5cf80-96f2-4fb8-b8dc-7763509a5add None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:15.273233 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5cf80-96f2-4fb8-b8dc-7763509a5add None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:15.274527 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 428/854] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:42:15.280315 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d46528-6b88-41c2-8295-2ac23c088dce None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:15.280852 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d46528-6b88-41c2-8295-2ac23c088dce None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:15.280852 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d46528-6b88-41c2-8295-2ac23c088dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:15.305650 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-f1d46528-6b88-41c2-8295-2ac23c088dce None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:42:15.307071 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-f1d46528-6b88-41c2-8295-2ac23c088dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:42:15.378957 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 427/855] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:42:15 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 09:42:15.715396 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5cf80-96f2-4fb8-b8dc-7763509a5add None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:15.742975 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:15.828404 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5cf80-96f2-4fb8-b8dc-7763509a5add None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:15.869405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff465a-42c9-4a58-b845-c2d3f2d5cae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:15.869974 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff465a-42c9-4a58-b845-c2d3f2d5cae5 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:15.870245 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff465a-42c9-4a58-b845-c2d3f2d5cae5 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:15.870509 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff465a-42c9-4a58-b845-c2d3f2d5cae5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:15.883892 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff465a-42c9-4a58-b845-c2d3f2d5cae5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:42:15.888765 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-80ff465a-42c9-4a58-b845-c2d3f2d5cae5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:42:15.888765 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:15.888765 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:15.888765 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:15.888765 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:15.888765 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:15.888765 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:15.888765 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:15.888765 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:15.888765 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:15.888765 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:15.888765 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:15.888765 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:42:15.888765 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:42:15.888765 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:42:15.888765 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:42:15.889925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:42:15.889925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:42:15.889925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:42:15.889925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:42:15.889925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:15.889925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:15.889925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:15.889925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:15.889925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:15.889925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:15.889925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:15.889925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:15.889925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:15.889925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:15.889925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:15.889925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:15.890752 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:15.890752 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:15.890752 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:15.890752 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:15.890752 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:42:15.890752 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:42:15.890752 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:42:15.890752 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:42:15.890752 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:42:15.890752 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:42:15.890752 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 09:42:15.890752 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:42:15.890752 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 429/856] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Sep 27 09:42:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:15.898074 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d46528-6b88-41c2-8295-2ac23c088dce None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:15.947616 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:16.017939 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d46528-6b88-41c2-8295-2ac23c088dce None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:16.056103 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1c1f3-5b05-4de1-9d8c-6d52aba1bf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:16.056728 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1c1f3-5b05-4de1-9d8c-6d52aba1bf06 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:16.057000 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1c1f3-5b05-4de1-9d8c-6d52aba1bf06 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:16.057270 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1c1f3-5b05-4de1-9d8c-6d52aba1bf06 None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:16.057956 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b1c1f3-5b05-4de1-9d8c-6d52aba1bf06 None admin] RBAC: Adding query filter params (name=service) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:16.058254 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b1c1f3-5b05-4de1-9d8c-6d52aba1bf06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:16.059667 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b1c1f3-5b05-4de1-9d8c-6d52aba1bf06 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:16.068809 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 428/857] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Sep 27 09:42:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:16.074894 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff465a-42c9-4a58-b845-c2d3f2d5cae5 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:16.186428 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:16.204856 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff465a-42c9-4a58-b845-c2d3f2d5cae5 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:16.246672 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841122d-e9d6-413e-a680-75770f1bfe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:16.247333 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841122d-e9d6-413e-a680-75770f1bfe0e None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:16.247602 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841122d-e9d6-413e-a680-75770f1bfe0e None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:16.247902 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841122d-e9d6-413e-a680-75770f1bfe0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:16.259108 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841122d-e9d6-413e-a680-75770f1bfe0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:16.260574 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841122d-e9d6-413e-a680-75770f1bfe0e None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:16.276849 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-8841122d-e9d6-413e-a680-75770f1bfe0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:42:16.276849 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:16.276849 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:16.276849 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:16.276849 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:16.276849 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:16.276849 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:16.276849 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:16.276849 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:16.276849 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:16.276849 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:16.276849 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:16.276849 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:42:16.276849 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:42:16.276849 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:42:16.276849 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:42:16.278454 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:16.278454 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:16.278454 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:16.278454 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:16.278454 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:16.278454 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:16.278454 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:16.278454 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:16.278454 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:16.278454 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:16.278454 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:16.278454 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:16.278454 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:16.278454 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:16.278454 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:16.278454 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:16.278454 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:42:16.279529 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:42:16.279529 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:42:16.279529 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:42:16.282974 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 430/858] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:42:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:16.284040 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1c1f3-5b05-4de1-9d8c-6d52aba1bf06 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:16.418647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1c1f3-5b05-4de1-9d8c-6d52aba1bf06 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:16.421216 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:16.463329 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04ece7-a611-4452-8777-8113edb0855b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:16.463860 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04ece7-a611-4452-8777-8113edb0855b None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:16.464245 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04ece7-a611-4452-8777-8113edb0855b None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:16.464391 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04ece7-a611-4452-8777-8113edb0855b None admin] PATH_INFO: `/v3/domains` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:16.465055 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04ece7-a611-4452-8777-8113edb0855b None admin] RBAC: Adding query filter params (name=Default) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:16.465357 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04ece7-a611-4452-8777-8113edb0855b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:16.466794 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04ece7-a611-4452-8777-8113edb0855b None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:16.489862 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 429/859] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:16.491271 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841122d-e9d6-413e-a680-75770f1bfe0e None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:16.619445 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841122d-e9d6-413e-a680-75770f1bfe0e None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:16.667859 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d44231-653a-497c-a2fd-2c7c8efc4ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:16.668906 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d44231-653a-497c-a2fd-2c7c8efc4ed7 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:16.669401 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d44231-653a-497c-a2fd-2c7c8efc4ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:16.669803 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d44231-653a-497c-a2fd-2c7c8efc4ed7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:16.674993 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:16.685642 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d44231-653a-497c-a2fd-2c7c8efc4ed7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:16.686635 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d44231-653a-497c-a2fd-2c7c8efc4ed7 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:16.703844 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-79d44231-653a-497c-a2fd-2c7c8efc4ed7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 09:42:16.703844 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:16.703844 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:16.703844 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:16.703844 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:16.703844 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:16.703844 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:16.703844 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:16.703844 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:16.703844 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:16.703844 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:16.703844 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:16.703844 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 09:42:16.703844 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 09:42:16.703844 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 09:42:16.703844 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 09:42:16.705834 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:16.705834 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:16.705834 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 09:42:16.705834 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:42:16.705834 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 09:42:16.705834 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:42:16.705834 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:16.705834 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:16.705834 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:16.705834 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:16.705834 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:16.705834 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:16.705834 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:16.705834 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:16.705834 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:16.705834 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:16.705834 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:16.705834 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:16.707262 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:16.707262 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:16.707262 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 09:42:16.707262 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 09:42:16.707262 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 09:42:16.707262 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 09:42:16.707262 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 09:42:16.707262 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 09:42:16.707262 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 27 09:42:16.707262 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:42:16.707262 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 431/860] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:42:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:16.711462 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04ece7-a611-4452-8777-8113edb0855b None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:16.826883 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04ece7-a611-4452-8777-8113edb0855b None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:16.866962 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6298bc-af2d-44df-9fdc-4d1de3bb982e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:16.867673 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6298bc-af2d-44df-9fdc-4d1de3bb982e None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:16.867978 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6298bc-af2d-44df-9fdc-4d1de3bb982e None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:16.868315 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6298bc-af2d-44df-9fdc-4d1de3bb982e None admin] PATH_INFO: `/v3/users` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:16.869074 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6298bc-af2d-44df-9fdc-4d1de3bb982e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:16.869381 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6298bc-af2d-44df-9fdc-4d1de3bb982e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:16.871059 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6298bc-af2d-44df-9fdc-4d1de3bb982e None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:16.891164 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 430/861] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Sep 27 09:42:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:16.897208 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d44231-653a-497c-a2fd-2c7c8efc4ed7 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:17.008891 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d44231-653a-497c-a2fd-2c7c8efc4ed7 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:17.049591 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8163d6-ef79-4287-bce9-86bfe96c21a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:17.050203 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8163d6-ef79-4287-bce9-86bfe96c21a0 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:17.050476 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8163d6-ef79-4287-bce9-86bfe96c21a0 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:17.050741 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8163d6-ef79-4287-bce9-86bfe96c21a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:17.119975 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:17.131133 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8163d6-ef79-4287-bce9-86bfe96c21a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:17.132991 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8163d6-ef79-4287-bce9-86bfe96c21a0 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:17.249184 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 432/862] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:42:16 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 09:42:17.255463 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6298bc-af2d-44df-9fdc-4d1de3bb982e None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:17.284095 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:17.369703 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6298bc-af2d-44df-9fdc-4d1de3bb982e None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:17.411456 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771dd60-3a95-45b4-abd9-ec28d4f4fb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:17.412201 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771dd60-3a95-45b4-abd9-ec28d4f4fb0f None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:17.412571 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771dd60-3a95-45b4-abd9-ec28d4f4fb0f None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:17.412955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771dd60-3a95-45b4-abd9-ec28d4f4fb0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:17.425193 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771dd60-3a95-45b4-abd9-ec28d4f4fb0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:17.426994 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771dd60-3a95-45b4-abd9-ec28d4f4fb0f None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:17.442595 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-1771dd60-3a95-45b4-abd9-ec28d4f4fb0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:42:17.442595 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:17.442595 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:17.442595 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:17.442595 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:17.442595 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:17.442595 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:17.442595 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:17.442595 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:17.442595 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:17.442595 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:17.442595 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:17.442595 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:42:17.442595 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:42:17.442595 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:42:17.442595 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:42:17.444175 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:17.444175 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:17.444175 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:17.444175 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:17.444175 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:17.444175 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:17.444175 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:17.444175 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:17.444175 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:17.444175 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:17.444175 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:17.444175 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:17.444175 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:17.444175 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:17.444175 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:17.444175 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:17.444175 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:42:17.445496 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:42:17.445496 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:42:17.445496 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:42:17.445496 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 431/863] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 09:42:17.449775 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8163d6-ef79-4287-bce9-86bfe96c21a0 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:17.552004 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:17.558917 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8163d6-ef79-4287-bce9-86bfe96c21a0 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:17.606372 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665bc4ec-ea6e-4cf2-9238-5fe076eaead8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:17.607038 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bc4ec-ea6e-4cf2-9238-5fe076eaead8 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:17.607315 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bc4ec-ea6e-4cf2-9238-5fe076eaead8 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:17.607592 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bc4ec-ea6e-4cf2-9238-5fe076eaead8 None admin] PATH_INFO: `/v3/domains` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:17.610605 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665bc4ec-ea6e-4cf2-9238-5fe076eaead8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:17.610605 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665bc4ec-ea6e-4cf2-9238-5fe076eaead8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:17.610605 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665bc4ec-ea6e-4cf2-9238-5fe076eaead8 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:17.622473 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 433/864] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:17.628212 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771dd60-3a95-45b4-abd9-ec28d4f4fb0f None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:17.712555 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:17.739998 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771dd60-3a95-45b4-abd9-ec28d4f4fb0f None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:17.776808 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99c27a-6161-426d-ac2a-745b5f50571e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:17.777449 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99c27a-6161-426d-ac2a-745b5f50571e None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:17.777728 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99c27a-6161-426d-ac2a-745b5f50571e None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:17.777999 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99c27a-6161-426d-ac2a-745b5f50571e None admin] PATH_INFO: `/v3/projects/service` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:17.785964 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99c27a-6161-426d-ac2a-745b5f50571e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:17.787682 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99c27a-6161-426d-ac2a-745b5f50571e None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:17.801478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-df99c27a-6161-426d-ac2a-745b5f50571e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:42:17.801478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:17.801478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:17.801478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:17.801478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:17.801478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:17.801478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:17.801478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:17.801478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:17.801478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:17.801478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:17.801478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:17.801478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 09:42:17.801478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 09:42:17.801478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 09:42:17.802633 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 09:42:17.802633 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:17.802633 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:17.802633 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:17.802633 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:17.802633 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:17.802633 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:17.802633 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:17.802633 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:17.802633 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:17.802633 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:17.802633 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:17.802633 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:17.802633 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:17.802633 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:17.802633 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:17.802633 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:17.803859 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 09:42:17.803859 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 09:42:17.803859 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 09:42:17.803859 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 09:42:17.803859 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 09:42:17.803859 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 09:42:17.803859 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:42:17.803859 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:42:17.803859 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 432/865] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:42:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:17.808931 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665bc4ec-ea6e-4cf2-9238-5fe076eaead8 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:17.922495 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665bc4ec-ea6e-4cf2-9238-5fe076eaead8 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:17.965059 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c7db0-4308-424a-86f9-dc8aa44f6ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:17.965615 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c7db0-4308-424a-86f9-dc8aa44f6ae6 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:17.965936 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c7db0-4308-424a-86f9-dc8aa44f6ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:17.966221 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c7db0-4308-424a-86f9-dc8aa44f6ae6 None admin] PATH_INFO: `/v3/projects` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:17.967046 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c7db0-4308-424a-86f9-dc8aa44f6ae6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:17.967365 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c7db0-4308-424a-86f9-dc8aa44f6ae6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:17.969121 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c7db0-4308-424a-86f9-dc8aa44f6ae6 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:17.985941 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 434/866] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 27 09:42:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:42:17.993010 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99c27a-6161-426d-ac2a-745b5f50571e None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:18.104348 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99c27a-6161-426d-ac2a-745b5f50571e None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:18.143612 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec860e13-2d53-4b66-ae98-34ae7dde337d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:18.144244 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec860e13-2d53-4b66-ae98-34ae7dde337d None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:18.144528 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec860e13-2d53-4b66-ae98-34ae7dde337d None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:18.144898 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec860e13-2d53-4b66-ae98-34ae7dde337d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:18.145808 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec860e13-2d53-4b66-ae98-34ae7dde337d None admin] RBAC: Adding query filter params (role.id=a3ad332ff078405ebc48aa8df0035cab, scope.project.id=dbe5c492b05e40448942bb2500c185ee, user.id=8d7d537583c64b5cabe287be6875a478) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:18.146130 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec860e13-2d53-4b66-ae98-34ae7dde337d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:18.147713 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec860e13-2d53-4b66-ae98-34ae7dde337d None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:18.149797 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:18.154423 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 433/867] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:42:17 2022] GET /identity/v3/role_assignments?user.id=8d7d537583c64b5cabe287be6875a478&scope.project.id=dbe5c492b05e40448942bb2500c185ee&role.id=a3ad332ff078405ebc48aa8df0035cab => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:20.656351 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a423811-5d25-448e-91fb-147d32bb4baa None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:20.656944 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a423811-5d25-448e-91fb-147d32bb4baa None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:20.656944 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a423811-5d25-448e-91fb-147d32bb4baa None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:20.658323 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 435/868] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:42:20.664978 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc230d8-2e2e-47e6-b4e1-9933496f8f53 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:20.665573 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc230d8-2e2e-47e6-b4e1-9933496f8f53 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:20.665573 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc230d8-2e2e-47e6-b4e1-9933496f8f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:20.686338 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-1dc230d8-2e2e-47e6-b4e1-9933496f8f53 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:42:20.687870 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-1dc230d8-2e2e-47e6-b4e1-9933496f8f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:42:20.772653 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 434/869] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:42:20 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 09:42:21.108931 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a423811-5d25-448e-91fb-147d32bb4baa None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:21.131691 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:21.245901 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a423811-5d25-448e-91fb-147d32bb4baa None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:21.286248 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d512f-084f-42cd-8c3c-665745917f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:21.287256 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d512f-084f-42cd-8c3c-665745917f27 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:21.287361 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d512f-084f-42cd-8c3c-665745917f27 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:21.287682 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d512f-084f-42cd-8c3c-665745917f27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:21.301351 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d512f-084f-42cd-8c3c-665745917f27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:42:21.306551 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-b77d512f-084f-42cd-8c3c-665745917f27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:42:21.306551 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:21.306551 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:21.306551 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:21.306551 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:21.306551 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:21.306551 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:21.306551 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:21.306551 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:21.306551 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:21.306551 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:21.306551 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:21.306551 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:42:21.306551 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:42:21.306551 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:42:21.306551 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:42:21.307848 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:42:21.307848 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:42:21.307848 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:42:21.307848 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:42:21.307848 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:21.307848 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:21.307848 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:21.307848 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:21.307848 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:21.307848 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:21.307848 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:21.307848 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:21.307848 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:21.307848 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:21.307848 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:21.307848 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:21.309565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:21.309565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:21.309565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:21.309565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:21.309565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:42:21.309565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:42:21.309565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:42:21.309565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:42:21.309565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:42:21.309565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:42:21.309565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:42:21.309565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:42:21.309565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 436/870] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 27 09:42:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 09:42:21.317082 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc230d8-2e2e-47e6-b4e1-9933496f8f53 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:21.453228 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc230d8-2e2e-47e6-b4e1-9933496f8f53 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:21.483877 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:21.493178 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdedc6-9c18-42e1-b60f-28bed1f2218d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:21.493809 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdedc6-9c18-42e1-b60f-28bed1f2218d None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:21.494081 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdedc6-9c18-42e1-b60f-28bed1f2218d None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:21.494346 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdedc6-9c18-42e1-b60f-28bed1f2218d None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:21.495060 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdedc6-9c18-42e1-b60f-28bed1f2218d None admin] RBAC: Adding query filter params (name=admin) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:21.495359 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdedc6-9c18-42e1-b60f-28bed1f2218d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:21.496760 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdedc6-9c18-42e1-b60f-28bed1f2218d None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:21.506720 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 435/871] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:42:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:42:21.512952 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d512f-084f-42cd-8c3c-665745917f27 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:21.603567 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:21.630259 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d512f-084f-42cd-8c3c-665745917f27 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:21.668239 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513813b-db61-4f1b-9f26-e332173d8790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:21.668973 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513813b-db61-4f1b-9f26-e332173d8790 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:21.669130 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513813b-db61-4f1b-9f26-e332173d8790 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:21.669428 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513813b-db61-4f1b-9f26-e332173d8790 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:21.682551 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513813b-db61-4f1b-9f26-e332173d8790 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:21.684072 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513813b-db61-4f1b-9f26-e332173d8790 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:21.700229 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-d513813b-db61-4f1b-9f26-e332173d8790 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:42:21.700229 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:21.700229 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:21.700229 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:21.700229 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:21.700229 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:21.700229 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:21.700229 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:21.700229 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:21.700229 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:21.700229 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:21.700229 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:21.700229 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:42:21.700229 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:42:21.700229 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:42:21.700229 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:42:21.701382 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:21.701382 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:21.701382 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:21.701382 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:21.701382 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:21.701382 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:21.701382 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:21.701382 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:21.701382 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:21.701382 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:21.701382 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:21.701382 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:21.701382 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:21.701382 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:21.701382 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:21.701382 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:21.701382 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:42:21.702425 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:42:21.702425 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:42:21.702425 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:42:21.702425 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 437/872] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:42:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:21.707489 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdedc6-9c18-42e1-b60f-28bed1f2218d None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:21.827166 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdedc6-9c18-42e1-b60f-28bed1f2218d None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:21.864969 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb320e-2bf2-4a84-ada5-b0810b0bb118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:21.865608 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb320e-2bf2-4a84-ada5-b0810b0bb118 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:21.865888 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb320e-2bf2-4a84-ada5-b0810b0bb118 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:21.866167 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb320e-2bf2-4a84-ada5-b0810b0bb118 None admin] PATH_INFO: `/v3/domains` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:21.866877 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb320e-2bf2-4a84-ada5-b0810b0bb118 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:21.867184 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb320e-2bf2-4a84-ada5-b0810b0bb118 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:21.868565 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb320e-2bf2-4a84-ada5-b0810b0bb118 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:21.882442 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 436/873] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:21.888170 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513813b-db61-4f1b-9f26-e332173d8790 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:21.996349 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513813b-db61-4f1b-9f26-e332173d8790 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:22.023767 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:22.032829 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ed505-9384-4a3a-85d1-eb4a1dc49085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:22.033468 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ed505-9384-4a3a-85d1-eb4a1dc49085 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:22.033746 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ed505-9384-4a3a-85d1-eb4a1dc49085 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:22.034013 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ed505-9384-4a3a-85d1-eb4a1dc49085 None admin] PATH_INFO: `/v3/users/placement` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:22.042409 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ed505-9384-4a3a-85d1-eb4a1dc49085 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:22.043895 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ed505-9384-4a3a-85d1-eb4a1dc49085 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:22.055676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-055ed505-9384-4a3a-85d1-eb4a1dc49085 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 09:42:22.055676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:22.055676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:22.055676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:22.055676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:22.055676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:22.055676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:22.055676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:22.055676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:22.055676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:22.055676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:22.055676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:22.055676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 09:42:22.055676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 09:42:22.055676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 09:42:22.055676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 09:42:22.056839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:22.056839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:22.056839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 09:42:22.056839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:42:22.056839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 09:42:22.056839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:42:22.056839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:22.056839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:22.056839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:22.056839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:22.056839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:22.056839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:22.056839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:22.056839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:22.056839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:22.056839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:22.056839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:22.056839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:22.057856 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:22.057856 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:22.057856 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 09:42:22.057856 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 09:42:22.057856 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 09:42:22.057856 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 09:42:22.057856 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 09:42:22.057856 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 09:42:22.057856 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 27 09:42:22.057856 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:42:22.057856 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 438/874] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:42:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:22.063707 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb320e-2bf2-4a84-ada5-b0810b0bb118 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:22.115955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:22.179394 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb320e-2bf2-4a84-ada5-b0810b0bb118 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:22.216904 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51454e18-d87f-4844-9b5e-8842b5e50349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:22.217513 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51454e18-d87f-4844-9b5e-8842b5e50349 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:22.217785 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51454e18-d87f-4844-9b5e-8842b5e50349 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:22.218049 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51454e18-d87f-4844-9b5e-8842b5e50349 None admin] PATH_INFO: `/v3/users` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:22.218806 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51454e18-d87f-4844-9b5e-8842b5e50349 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:22.219110 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51454e18-d87f-4844-9b5e-8842b5e50349 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:22.220576 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51454e18-d87f-4844-9b5e-8842b5e50349 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:22.239972 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 437/875] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Sep 27 09:42:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:22.245986 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ed505-9384-4a3a-85d1-eb4a1dc49085 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:22.356527 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ed505-9384-4a3a-85d1-eb4a1dc49085 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:22.391819 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262af34f-fbf5-4585-8cb0-35974c6af0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:22.392427 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262af34f-fbf5-4585-8cb0-35974c6af0aa None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:22.392696 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262af34f-fbf5-4585-8cb0-35974c6af0aa None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:22.392980 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262af34f-fbf5-4585-8cb0-35974c6af0aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:22.453967 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:22.467812 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262af34f-fbf5-4585-8cb0-35974c6af0aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:22.469283 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262af34f-fbf5-4585-8cb0-35974c6af0aa None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:22.575903 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 439/876] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:42:22 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 09:42:22.582107 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51454e18-d87f-4844-9b5e-8842b5e50349 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:22.685535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51454e18-d87f-4844-9b5e-8842b5e50349 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:22.695147 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:22.720796 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6101cd9-6e4b-4d0d-988d-7064b77d9d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:22.721461 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6101cd9-6e4b-4d0d-988d-7064b77d9d67 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:22.721700 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6101cd9-6e4b-4d0d-988d-7064b77d9d67 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:22.721968 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6101cd9-6e4b-4d0d-988d-7064b77d9d67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:22.733112 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6101cd9-6e4b-4d0d-988d-7064b77d9d67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:22.734609 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6101cd9-6e4b-4d0d-988d-7064b77d9d67 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:22.750332 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-e6101cd9-6e4b-4d0d-988d-7064b77d9d67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:42:22.750332 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:22.750332 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:22.750332 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:22.750332 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:22.750332 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:22.750332 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:22.750332 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:22.750332 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:22.750332 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:22.750332 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:22.750332 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:22.750332 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:42:22.750332 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:42:22.750332 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:42:22.750332 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:42:22.751539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:22.751539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:22.751539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:22.751539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:22.751539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:22.751539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:22.751539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:22.751539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:22.751539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:22.751539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:22.751539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:22.751539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:22.751539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:22.751539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:22.751539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:22.751539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:22.751539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:42:22.752647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:42:22.752647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:42:22.752647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:42:22.752647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 438/877] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:22.757445 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262af34f-fbf5-4585-8cb0-35974c6af0aa None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:22.849895 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:22.863648 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262af34f-fbf5-4585-8cb0-35974c6af0aa None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:22.903020 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8e9ca-9b90-459b-8fe9-3ef2b3be7b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:22.903640 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8e9ca-9b90-459b-8fe9-3ef2b3be7b59 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:22.903913 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8e9ca-9b90-459b-8fe9-3ef2b3be7b59 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:22.904177 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8e9ca-9b90-459b-8fe9-3ef2b3be7b59 None admin] PATH_INFO: `/v3/domains` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:22.904815 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8e9ca-9b90-459b-8fe9-3ef2b3be7b59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:22.905109 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8e9ca-9b90-459b-8fe9-3ef2b3be7b59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:22.906499 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8e9ca-9b90-459b-8fe9-3ef2b3be7b59 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:22.919661 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 440/878] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:22.925653 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6101cd9-6e4b-4d0d-988d-7064b77d9d67 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:23.035823 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6101cd9-6e4b-4d0d-988d-7064b77d9d67 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:23.072066 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ccacf-6b64-4655-9da5-4703a494e4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:23.072732 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ccacf-6b64-4655-9da5-4703a494e4f7 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:23.073008 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ccacf-6b64-4655-9da5-4703a494e4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:23.073271 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ccacf-6b64-4655-9da5-4703a494e4f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:23.081823 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ccacf-6b64-4655-9da5-4703a494e4f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:23.083689 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ccacf-6b64-4655-9da5-4703a494e4f7 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:23.105790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-073ccacf-6b64-4655-9da5-4703a494e4f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:42:23.105790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:23.105790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:23.105790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:23.105790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:23.105790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:23.105790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:23.105790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:23.105790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:23.105790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:23.105790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:23.105790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:23.105790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 09:42:23.105790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 09:42:23.105790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 09:42:23.106966 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 09:42:23.106966 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:23.106966 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:23.106966 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:23.106966 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:23.106966 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:23.106966 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:23.106966 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:23.106966 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:23.106966 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:23.106966 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:23.106966 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:23.106966 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:23.106966 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:23.106966 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:23.106966 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:23.106966 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:23.107928 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 09:42:23.107928 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 09:42:23.107928 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 09:42:23.107928 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 09:42:23.107928 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 09:42:23.107928 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 09:42:23.107928 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:42:23.107928 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:42:23.107928 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 439/879] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:42:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:23.113380 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8e9ca-9b90-459b-8fe9-3ef2b3be7b59 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:23.220524 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8e9ca-9b90-459b-8fe9-3ef2b3be7b59 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:23.257599 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1829857-59fa-4558-93ae-5f4d2f547b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:23.258203 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1829857-59fa-4558-93ae-5f4d2f547b6f None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:23.258472 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1829857-59fa-4558-93ae-5f4d2f547b6f None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:23.258734 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1829857-59fa-4558-93ae-5f4d2f547b6f None admin] PATH_INFO: `/v3/projects` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:23.259449 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1829857-59fa-4558-93ae-5f4d2f547b6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:23.259743 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1829857-59fa-4558-93ae-5f4d2f547b6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:23.261177 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1829857-59fa-4558-93ae-5f4d2f547b6f None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:23.274015 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 441/880] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 27 09:42:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:23.280388 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ccacf-6b64-4655-9da5-4703a494e4f7 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:23.306345 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:23.394181 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ccacf-6b64-4655-9da5-4703a494e4f7 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:23.431597 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66625f2-3f68-428e-9e40-351a6e177fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:23.432186 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66625f2-3f68-428e-9e40-351a6e177fbf None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:23.432465 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66625f2-3f68-428e-9e40-351a6e177fbf None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:23.432730 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66625f2-3f68-428e-9e40-351a6e177fbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:23.433442 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66625f2-3f68-428e-9e40-351a6e177fbf None admin] RBAC: Adding query filter params (role.id=7cc7d3c85c794033b590117321e97ccf, scope.project.id=dbe5c492b05e40448942bb2500c185ee, user.id=8d7d537583c64b5cabe287be6875a478) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:23.433741 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66625f2-3f68-428e-9e40-351a6e177fbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:23.435198 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66625f2-3f68-428e-9e40-351a6e177fbf None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:23.440714 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 440/881] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:42:23 2022] GET /identity/v3/role_assignments?user.id=8d7d537583c64b5cabe287be6875a478&scope.project.id=dbe5c492b05e40448942bb2500c185ee&role.id=7cc7d3c85c794033b590117321e97ccf => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:25.922224 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4704f2-f9d0-4f05-8c1c-fb78c5384897 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:25.922826 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4704f2-f9d0-4f05-8c1c-fb78c5384897 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:25.922826 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4704f2-f9d0-4f05-8c1c-fb78c5384897 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:25.924064 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 442/882] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:42:25.930344 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d7661-b5b8-436f-ab4f-f270d775f0d3 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:25.930924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d7661-b5b8-436f-ab4f-f270d775f0d3 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:25.930924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d7661-b5b8-436f-ab4f-f270d775f0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:25.949866 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-964d7661-b5b8-436f-ab4f-f270d775f0d3 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:42:25.951085 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-964d7661-b5b8-436f-ab4f-f270d775f0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:42:26.026485 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 441/883] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:42:25 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 09:42:26.386374 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4704f2-f9d0-4f05-8c1c-fb78c5384897 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:26.398213 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:26.517757 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4704f2-f9d0-4f05-8c1c-fb78c5384897 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:26.553413 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8296e-4fc5-41d9-95c3-d32bf8868a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:26.554046 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8296e-4fc5-41d9-95c3-d32bf8868a0a None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:26.554308 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8296e-4fc5-41d9-95c3-d32bf8868a0a None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:26.554571 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8296e-4fc5-41d9-95c3-d32bf8868a0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:26.566107 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8296e-4fc5-41d9-95c3-d32bf8868a0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:42:26.573656 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-c2b8296e-4fc5-41d9-95c3-d32bf8868a0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:42:26.573656 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:26.573656 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:26.573656 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:26.573656 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:26.573656 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:26.573656 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:26.573656 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:26.573656 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:26.573656 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:26.573656 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:26.573656 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:26.573656 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:42:26.573656 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:42:26.573656 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:42:26.573656 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:42:26.574811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:42:26.574811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:42:26.574811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:42:26.574811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:42:26.574811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:26.574811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:26.574811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:26.574811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:26.574811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:26.574811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:26.574811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:26.574811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:26.574811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:26.574811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:26.574811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:26.574811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:26.575660 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:26.575660 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:26.575660 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:26.575660 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:26.575660 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:42:26.575660 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:42:26.575660 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:42:26.575660 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:42:26.575660 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:42:26.575660 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:42:26.575660 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:42:26.575660 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:42:26.575660 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 443/884] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 27 09:42:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:26.583627 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d7661-b5b8-436f-ab4f-f270d775f0d3 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:26.599893 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:26.692656 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d7661-b5b8-436f-ab4f-f270d775f0d3 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:26.729903 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b0d4d-de06-42e3-99ea-aca8e43281ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:26.730522 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b0d4d-de06-42e3-99ea-aca8e43281ff None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:26.730818 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b0d4d-de06-42e3-99ea-aca8e43281ff None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:26.731092 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b0d4d-de06-42e3-99ea-aca8e43281ff None admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:26.731757 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b0d4d-de06-42e3-99ea-aca8e43281ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:26.732057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b0d4d-de06-42e3-99ea-aca8e43281ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:26.733438 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b0d4d-de06-42e3-99ea-aca8e43281ff None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:26.742893 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 442/885] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:42:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:26.748992 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8296e-4fc5-41d9-95c3-d32bf8868a0a None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:26.827327 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:26.865419 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8296e-4fc5-41d9-95c3-d32bf8868a0a None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:26.904345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c615a5-969f-4f73-9843-e8477da6b3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:26.904996 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c615a5-969f-4f73-9843-e8477da6b3ef None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:26.905271 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c615a5-969f-4f73-9843-e8477da6b3ef None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:26.905555 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c615a5-969f-4f73-9843-e8477da6b3ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:26.917833 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c615a5-969f-4f73-9843-e8477da6b3ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:26.924547 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c615a5-969f-4f73-9843-e8477da6b3ef None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:26.936230 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-42c615a5-969f-4f73-9843-e8477da6b3ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:42:26.936230 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:26.936230 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:26.936230 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:26.936230 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:26.936230 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:26.936230 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:26.936230 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:26.936230 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:26.936230 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:26.936230 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:26.936230 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:26.936230 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:42:26.936230 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:42:26.936230 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:42:26.936230 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:42:26.937436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:26.937436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:26.937436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:26.937436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:26.937436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:26.937436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:26.937436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:26.937436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:26.937436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:26.937436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:26.937436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:26.937436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:26.937436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:26.937436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:26.937436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:26.937436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:26.937436 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:42:26.938379 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:42:26.938379 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:42:26.938379 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:42:26.938379 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 444/886] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:26.946124 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b0d4d-de06-42e3-99ea-aca8e43281ff None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:27.046530 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:27.073658 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b0d4d-de06-42e3-99ea-aca8e43281ff None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:27.113307 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b47b3-ad8b-4e01-a7e7-7b9b8f09470c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:27.114116 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b47b3-ad8b-4e01-a7e7-7b9b8f09470c None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:27.114426 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b47b3-ad8b-4e01-a7e7-7b9b8f09470c None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:27.114802 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b47b3-ad8b-4e01-a7e7-7b9b8f09470c None admin] PATH_INFO: `/v3/domains` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:27.115519 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b47b3-ad8b-4e01-a7e7-7b9b8f09470c None admin] RBAC: Adding query filter params (name=Default) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:27.115985 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b47b3-ad8b-4e01-a7e7-7b9b8f09470c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:27.117466 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b47b3-ad8b-4e01-a7e7-7b9b8f09470c None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:27.133620 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 443/887] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:27.140284 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c615a5-969f-4f73-9843-e8477da6b3ef None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:27.264317 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c615a5-969f-4f73-9843-e8477da6b3ef None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:27.286942 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:27.304572 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3f4d6-d6ba-4266-9515-e3e8a9262126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:27.305214 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3f4d6-d6ba-4266-9515-e3e8a9262126 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:27.305487 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3f4d6-d6ba-4266-9515-e3e8a9262126 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:27.305753 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3f4d6-d6ba-4266-9515-e3e8a9262126 None admin] PATH_INFO: `/v3/users/placement` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:27.315117 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3f4d6-d6ba-4266-9515-e3e8a9262126 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:27.316623 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3f4d6-d6ba-4266-9515-e3e8a9262126 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:27.328345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-40e3f4d6-d6ba-4266-9515-e3e8a9262126 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 09:42:27.328345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:27.328345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:27.328345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:27.328345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:27.328345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:27.328345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:27.328345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:27.328345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:27.328345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:27.328345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:27.328345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:27.328345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 09:42:27.328345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 09:42:27.328345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 09:42:27.328345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 09:42:27.329537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:27.329537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:27.329537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 09:42:27.329537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:42:27.329537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 09:42:27.329537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:42:27.329537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:27.329537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:27.329537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:27.329537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:27.329537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:27.329537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:27.329537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:27.329537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:27.329537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:27.329537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:27.329537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:27.329537 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:27.330730 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:27.330730 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:27.330730 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 09:42:27.330730 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 09:42:27.330730 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 09:42:27.330730 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 09:42:27.330730 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 09:42:27.330730 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 09:42:27.330730 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 27 09:42:27.330730 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:42:27.330730 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 445/888] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:42:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:27.335748 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b47b3-ad8b-4e01-a7e7-7b9b8f09470c None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:27.439855 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b47b3-ad8b-4e01-a7e7-7b9b8f09470c None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:27.476712 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9792252-f726-47c0-99e4-8170b1b7d949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:27.477325 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9792252-f726-47c0-99e4-8170b1b7d949 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:27.477597 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9792252-f726-47c0-99e4-8170b1b7d949 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:27.477865 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9792252-f726-47c0-99e4-8170b1b7d949 None admin] PATH_INFO: `/v3/users` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:27.478575 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9792252-f726-47c0-99e4-8170b1b7d949 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:27.478915 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9792252-f726-47c0-99e4-8170b1b7d949 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:27.480352 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9792252-f726-47c0-99e4-8170b1b7d949 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:27.483235 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:27.498978 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 444/889] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Sep 27 09:42:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:27.504990 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3f4d6-d6ba-4266-9515-e3e8a9262126 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:27.618257 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3f4d6-d6ba-4266-9515-e3e8a9262126 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:27.660866 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49639799-e2ac-46d5-8fda-11adc42f7c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:27.661719 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49639799-e2ac-46d5-8fda-11adc42f7c58 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:27.662001 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49639799-e2ac-46d5-8fda-11adc42f7c58 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:27.662274 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49639799-e2ac-46d5-8fda-11adc42f7c58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:27.675118 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49639799-e2ac-46d5-8fda-11adc42f7c58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:27.676999 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49639799-e2ac-46d5-8fda-11adc42f7c58 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:27.692315 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-49639799-e2ac-46d5-8fda-11adc42f7c58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:42:27.692315 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:27.692315 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:27.692315 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:27.692315 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:27.692315 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:27.692315 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:27.692315 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:27.692315 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:27.692315 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:27.692315 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:27.692315 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:27.692315 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:42:27.692315 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:42:27.692315 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:42:27.692315 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:42:27.693345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:27.693345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:27.693345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:27.693345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:27.693345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:27.693345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:27.693345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:27.693345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:27.693345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:27.693345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:27.693345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:27.693345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:27.693345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:27.693345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:27.693345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:27.693345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:27.693345 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:42:27.694227 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:42:27.694227 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:42:27.694227 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:42:27.694227 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 446/890] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:27.699537 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9792252-f726-47c0-99e4-8170b1b7d949 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:27.804970 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9792252-f726-47c0-99e4-8170b1b7d949 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:27.840748 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b2675-a9a1-44e7-95fa-b5806d9d1551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:27.841269 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b2675-a9a1-44e7-95fa-b5806d9d1551 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:27.841544 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b2675-a9a1-44e7-95fa-b5806d9d1551 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:27.841816 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b2675-a9a1-44e7-95fa-b5806d9d1551 None admin] PATH_INFO: `/v3/domains` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:27.842468 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b2675-a9a1-44e7-95fa-b5806d9d1551 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:27.842808 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b2675-a9a1-44e7-95fa-b5806d9d1551 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:27.844176 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b2675-a9a1-44e7-95fa-b5806d9d1551 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:27.856600 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 445/891] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:27.862491 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49639799-e2ac-46d5-8fda-11adc42f7c58 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:27.897931 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:27.976131 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49639799-e2ac-46d5-8fda-11adc42f7c58 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:28.013485 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16465e8f-3818-40b1-9e28-34a1861e0979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:28.014134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16465e8f-3818-40b1-9e28-34a1861e0979 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:28.014413 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16465e8f-3818-40b1-9e28-34a1861e0979 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:28.014684 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16465e8f-3818-40b1-9e28-34a1861e0979 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:28.022273 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16465e8f-3818-40b1-9e28-34a1861e0979 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:28.023769 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16465e8f-3818-40b1-9e28-34a1861e0979 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:28.035637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-16465e8f-3818-40b1-9e28-34a1861e0979 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:42:28.035637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:28.035637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:28.035637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:28.035637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:28.035637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:28.035637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:28.035637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:28.035637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:28.035637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:28.035637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:28.035637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:28.035637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 09:42:28.035637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 09:42:28.035637 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 09:42:28.036744 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 09:42:28.036744 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:28.036744 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:28.036744 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:28.036744 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:28.036744 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:28.036744 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:28.036744 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:28.036744 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:28.036744 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:28.036744 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:28.036744 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:28.036744 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:28.036744 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:28.036744 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:28.036744 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:28.036744 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:28.037970 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 09:42:28.037970 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 09:42:28.037970 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 09:42:28.037970 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 09:42:28.037970 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 09:42:28.037970 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 09:42:28.037970 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:42:28.037970 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:42:28.037970 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 447/892] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:42:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:28.043332 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b2675-a9a1-44e7-95fa-b5806d9d1551 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:28.101230 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:28.148270 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b2675-a9a1-44e7-95fa-b5806d9d1551 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:28.182918 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85461255-8fc5-43b5-beb1-3e9e85f0bb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:28.183517 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85461255-8fc5-43b5-beb1-3e9e85f0bb06 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:28.183796 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85461255-8fc5-43b5-beb1-3e9e85f0bb06 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:28.184065 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85461255-8fc5-43b5-beb1-3e9e85f0bb06 None admin] PATH_INFO: `/v3/projects` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:28.184759 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85461255-8fc5-43b5-beb1-3e9e85f0bb06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:28.185064 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85461255-8fc5-43b5-beb1-3e9e85f0bb06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:28.186493 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85461255-8fc5-43b5-beb1-3e9e85f0bb06 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:28.199012 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 446/893] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 27 09:42:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:28.205261 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16465e8f-3818-40b1-9e28-34a1861e0979 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:28.304630 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:28.315993 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16465e8f-3818-40b1-9e28-34a1861e0979 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:28.350726 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc9ebb-f131-434b-8d6f-32661cdad121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:28.351494 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc9ebb-f131-434b-8d6f-32661cdad121 None admin] REQUEST_METHOD: `PUT` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:28.351697 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc9ebb-f131-434b-8d6f-32661cdad121 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:28.351969 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc9ebb-f131-434b-8d6f-32661cdad121 None admin] PATH_INFO: `/v3/projects/dbe5c492b05e40448942bb2500c185ee/users/8d7d537583c64b5cabe287be6875a478/roles/7cc7d3c85c794033b590117321e97ccf` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:28.353978 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc9ebb-f131-434b-8d6f-32661cdad121 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbe5c492b05e40448942bb2500c185ee, user_id=8d7d537583c64b5cabe287be6875a478, role_id=7cc7d3c85c794033b590117321e97ccf)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:28.355453 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc9ebb-f131-434b-8d6f-32661cdad121 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:28.372379 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 448/894] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Sep 27 09:42:28 2022] PUT /identity/v3/projects/dbe5c492b05e40448942bb2500c185ee/users/8d7d537583c64b5cabe287be6875a478/roles/7cc7d3c85c794033b590117321e97ccf => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 09:42:30.824206 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ac1fd-89da-4bca-955a-faf50bb98239 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:30.824834 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ac1fd-89da-4bca-955a-faf50bb98239 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:30.824945 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ac1fd-89da-4bca-955a-faf50bb98239 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:30.826924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 447/895] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:42:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:42:30.833152 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f236df-8a48-4884-a0b3-6efae9e7efd8 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:30.833631 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f236df-8a48-4884-a0b3-6efae9e7efd8 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:30.833727 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f236df-8a48-4884-a0b3-6efae9e7efd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:30.854508 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-60f236df-8a48-4884-a0b3-6efae9e7efd8 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:42:30.855667 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-60f236df-8a48-4884-a0b3-6efae9e7efd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:42:30.928895 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 449/896] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:42:30 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 09:42:31.289909 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ac1fd-89da-4bca-955a-faf50bb98239 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:31.406288 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ac1fd-89da-4bca-955a-faf50bb98239 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:31.424458 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:31.450054 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27806a6-3f7c-4735-8e2b-244e3b9d9945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:31.450704 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27806a6-3f7c-4735-8e2b-244e3b9d9945 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:31.451018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27806a6-3f7c-4735-8e2b-244e3b9d9945 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:31.451285 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27806a6-3f7c-4735-8e2b-244e3b9d9945 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:31.463382 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27806a6-3f7c-4735-8e2b-244e3b9d9945 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 09:42:31.468457 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-c27806a6-3f7c-4735-8e2b-244e3b9d9945 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:42:31.468457 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:31.468457 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:31.468457 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:31.468457 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:31.468457 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:31.468457 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:31.468457 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:31.468457 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:31.468457 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:31.468457 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:31.468457 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:31.468457 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 09:42:31.468457 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 09:42:31.468457 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 09:42:31.468457 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 09:42:31.469858 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 09:42:31.469858 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 09:42:31.469858 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 09:42:31.469858 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 09:42:31.469858 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:31.469858 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:31.469858 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:31.469858 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:31.469858 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:31.469858 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:31.469858 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:31.469858 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:31.469858 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:31.469858 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:31.469858 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:31.469858 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:31.471233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:31.471233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:31.471233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:31.471233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:31.471233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 09:42:31.471233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 09:42:31.471233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 09:42:31.471233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 09:42:31.471233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 09:42:31.471233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 09:42:31.471233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 09:42:31.471233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:42:31.471233 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 448/897] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Sep 27 09:42:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:31.478754 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f236df-8a48-4884-a0b3-6efae9e7efd8 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:31.570059 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:31.593993 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f236df-8a48-4884-a0b3-6efae9e7efd8 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:31.633998 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4cf70-c0e4-41bd-a5fb-419737c8990c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:31.634678 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4cf70-c0e4-41bd-a5fb-419737c8990c None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:31.634999 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4cf70-c0e4-41bd-a5fb-419737c8990c None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:31.635265 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4cf70-c0e4-41bd-a5fb-419737c8990c None admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:31.635930 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4cf70-c0e4-41bd-a5fb-419737c8990c None admin] RBAC: Adding query filter params (name=admin) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:31.636303 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4cf70-c0e4-41bd-a5fb-419737c8990c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:31.637707 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4cf70-c0e4-41bd-a5fb-419737c8990c None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:31.647370 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 450/898] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Sep 27 09:42:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:31.655481 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27806a6-3f7c-4735-8e2b-244e3b9d9945 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:31.770544 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27806a6-3f7c-4735-8e2b-244e3b9d9945 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:31.807968 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a2962-bb13-43e0-88dd-1a357f29ff38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:31.808604 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a2962-bb13-43e0-88dd-1a357f29ff38 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:31.808880 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a2962-bb13-43e0-88dd-1a357f29ff38 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:31.809147 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a2962-bb13-43e0-88dd-1a357f29ff38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:31.820561 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a2962-bb13-43e0-88dd-1a357f29ff38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:31.822018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a2962-bb13-43e0-88dd-1a357f29ff38 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:31.838827 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-9b4a2962-bb13-43e0-88dd-1a357f29ff38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:42:31.838827 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:31.838827 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:31.838827 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:31.838827 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:31.838827 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:31.838827 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:31.838827 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:31.838827 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:31.838827 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:31.838827 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:31.838827 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:31.838827 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:42:31.838827 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:42:31.838827 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:42:31.838827 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:42:31.842297 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:31.842297 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:31.842297 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:31.842297 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:31.842297 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:31.842297 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:31.842297 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:31.842297 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:31.842297 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:31.842297 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:31.842297 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:31.842297 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:31.842297 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:31.842297 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:31.842297 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:31.842297 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:31.842297 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:42:31.843466 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:42:31.843466 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:42:31.843466 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:42:31.843466 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 449/899] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:31.847956 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4cf70-c0e4-41bd-a5fb-419737c8990c None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:31.963747 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4cf70-c0e4-41bd-a5fb-419737c8990c None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:32.009184 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d81dea-5b82-40ca-a4b9-67e38d6c9ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:32.009885 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d81dea-5b82-40ca-a4b9-67e38d6c9ab6 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:32.010253 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d81dea-5b82-40ca-a4b9-67e38d6c9ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:32.010483 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d81dea-5b82-40ca-a4b9-67e38d6c9ab6 None admin] PATH_INFO: `/v3/domains` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:32.011206 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d81dea-5b82-40ca-a4b9-67e38d6c9ab6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:32.011506 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d81dea-5b82-40ca-a4b9-67e38d6c9ab6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:32.013655 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d81dea-5b82-40ca-a4b9-67e38d6c9ab6 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:32.027748 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 451/900] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:32.033988 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a2962-bb13-43e0-88dd-1a357f29ff38 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:32.067895 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:32.153588 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a2962-bb13-43e0-88dd-1a357f29ff38 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:32.192035 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b8ba4-d5cb-4ce1-85e0-73f2584604b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:32.192728 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b8ba4-d5cb-4ce1-85e0-73f2584604b8 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:32.193010 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b8ba4-d5cb-4ce1-85e0-73f2584604b8 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:32.193385 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b8ba4-d5cb-4ce1-85e0-73f2584604b8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:32.202346 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b8ba4-d5cb-4ce1-85e0-73f2584604b8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:32.204054 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b8ba4-d5cb-4ce1-85e0-73f2584604b8 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:32.217333 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-a97b8ba4-d5cb-4ce1-85e0-73f2584604b8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 09:42:32.217333 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:32.217333 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:32.217333 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:32.217333 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:32.217333 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:32.217333 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:32.217333 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:32.217333 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:32.217333 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:32.217333 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:32.217333 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:32.217333 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 09:42:32.217333 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 09:42:32.217333 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 09:42:32.217333 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 09:42:32.218557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:32.218557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:32.218557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 09:42:32.218557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:42:32.218557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 09:42:32.218557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 09:42:32.218557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:32.218557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:32.218557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:32.218557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:32.218557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:32.218557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:32.218557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:32.218557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:32.218557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:32.218557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:32.218557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:32.218557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:32.219575 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:32.219575 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:32.219575 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 09:42:32.219575 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 09:42:32.219575 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 09:42:32.219575 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 09:42:32.219575 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 09:42:32.219575 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 09:42:32.219575 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 27 09:42:32.219575 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:42:32.219575 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 450/901] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:42:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:32.224917 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d81dea-5b82-40ca-a4b9-67e38d6c9ab6 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:32.229108 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:32.353461 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d81dea-5b82-40ca-a4b9-67e38d6c9ab6 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:32.394711 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afcfc12-60c1-41f4-a63c-9e94a77a3d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:32.395971 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcfc12-60c1-41f4-a63c-9e94a77a3d73 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:32.396248 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcfc12-60c1-41f4-a63c-9e94a77a3d73 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:32.396514 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcfc12-60c1-41f4-a63c-9e94a77a3d73 None admin] PATH_INFO: `/v3/users` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:32.397273 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afcfc12-60c1-41f4-a63c-9e94a77a3d73 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:32.397576 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afcfc12-60c1-41f4-a63c-9e94a77a3d73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:32.399122 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afcfc12-60c1-41f4-a63c-9e94a77a3d73 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:32.427154 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 452/902] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Sep 27 09:42:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:32.433120 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b8ba4-d5cb-4ce1-85e0-73f2584604b8 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:32.526484 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:32.543983 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b8ba4-d5cb-4ce1-85e0-73f2584604b8 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:32.584201 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b22e36-6937-451b-ac78-fd460e42fad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:32.584820 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b22e36-6937-451b-ac78-fd460e42fad9 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:32.585622 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b22e36-6937-451b-ac78-fd460e42fad9 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:32.585622 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b22e36-6937-451b-ac78-fd460e42fad9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:32.656709 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b22e36-6937-451b-ac78-fd460e42fad9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:32.658160 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b22e36-6937-451b-ac78-fd460e42fad9 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:32.745556 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:32.762449 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 451/903] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Sep 27 09:42:32 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 09:42:32.768718 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afcfc12-60c1-41f4-a63c-9e94a77a3d73 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:32.832628 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:32.875798 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afcfc12-60c1-41f4-a63c-9e94a77a3d73 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:32.912179 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67020793-0cc2-434b-9310-7565896cd544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:32.912812 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67020793-0cc2-434b-9310-7565896cd544 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:32.913087 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67020793-0cc2-434b-9310-7565896cd544 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:32.913364 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67020793-0cc2-434b-9310-7565896cd544 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:32.924122 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67020793-0cc2-434b-9310-7565896cd544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:32.925603 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67020793-0cc2-434b-9310-7565896cd544 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:32.940867 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-67020793-0cc2-434b-9310-7565896cd544 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:42:32.940867 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:32.940867 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:32.940867 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:32.940867 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:32.940867 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:32.940867 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:32.940867 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:32.940867 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:32.940867 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:32.940867 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:32.940867 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:32.940867 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 09:42:32.940867 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 09:42:32.940867 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 09:42:32.940867 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 09:42:32.942349 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:32.942349 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:32.942349 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:32.942349 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:32.942349 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:32.942349 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:32.942349 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:32.942349 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:32.942349 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:32.942349 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:32.942349 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:32.942349 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:32.942349 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:32.942349 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:32.942349 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:32.942349 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:32.942349 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 09:42:32.943298 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 09:42:32.943298 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 09:42:32.943298 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:42:32.943298 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 453/904] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:42:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:32.948470 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b22e36-6937-451b-ac78-fd460e42fad9 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:33.050894 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b22e36-6937-451b-ac78-fd460e42fad9 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:33.086009 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b2e46-1801-403f-9112-c047be8c86e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:33.086610 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b2e46-1801-403f-9112-c047be8c86e3 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:33.086923 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b2e46-1801-403f-9112-c047be8c86e3 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:33.087191 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b2e46-1801-403f-9112-c047be8c86e3 None admin] PATH_INFO: `/v3/domains` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:33.087833 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b2e46-1801-403f-9112-c047be8c86e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:33.088098 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b2e46-1801-403f-9112-c047be8c86e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:33.089498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b2e46-1801-403f-9112-c047be8c86e3 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:33.101026 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 452/905] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Sep 27 09:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:33.107055 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67020793-0cc2-434b-9310-7565896cd544 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:33.215641 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67020793-0cc2-434b-9310-7565896cd544 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:33.229905 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:33.252663 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7879f-ce09-4820-9548-e130a50c1b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:33.253292 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7879f-ce09-4820-9548-e130a50c1b02 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:33.253563 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7879f-ce09-4820-9548-e130a50c1b02 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:33.253838 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7879f-ce09-4820-9548-e130a50c1b02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:33.260923 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa7879f-ce09-4820-9548-e130a50c1b02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:33.262365 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa7879f-ce09-4820-9548-e130a50c1b02 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:33.274648 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application [None req-4fa7879f-ce09-4820-9548-e130a50c1b02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:42:33.274648 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:33.274648 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:33.274648 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:33.274648 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:33.274648 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:33.274648 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:33.274648 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:33.274648 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:33.274648 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:33.274648 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:33.274648 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:33.274648 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 09:42:33.274648 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 09:42:33.274648 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 09:42:33.275576 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 09:42:33.275576 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:33.275576 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:33.275576 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:33.275576 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:33.275576 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:33.275576 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:33.275576 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:33.275576 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:33.275576 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:33.275576 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:33.275576 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:33.275576 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:33.275576 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:33.275576 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:33.275576 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:33.275576 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:33.276479 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 09:42:33.276479 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 09:42:33.276479 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 09:42:33.276479 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 09:42:33.276479 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 09:42:33.276479 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 09:42:33.276479 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 09:42:33.276479 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: ERROR keystone.server.flask.application Sep 27 09:42:33.276479 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 454/906] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Sep 27 09:42:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:33.282025 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b2e46-1801-403f-9112-c047be8c86e3 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:33.332121 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:33.387370 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b2e46-1801-403f-9112-c047be8c86e3 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:33.424178 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476412d8-481f-408e-8a8c-2df8a07d5eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:33.424783 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476412d8-481f-408e-8a8c-2df8a07d5eda None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:33.425052 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476412d8-481f-408e-8a8c-2df8a07d5eda None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:33.425313 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476412d8-481f-408e-8a8c-2df8a07d5eda None admin] PATH_INFO: `/v3/projects` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:33.426190 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476412d8-481f-408e-8a8c-2df8a07d5eda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:33.426492 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476412d8-481f-408e-8a8c-2df8a07d5eda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:33.427957 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476412d8-481f-408e-8a8c-2df8a07d5eda None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:33.439909 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 453/907] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Sep 27 09:42:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:33.446800 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7879f-ce09-4820-9548-e130a50c1b02 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:33.552729 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7879f-ce09-4820-9548-e130a50c1b02 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:33.590427 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239382af-d546-497b-aba3-347ceb6fd006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:33.591083 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239382af-d546-497b-aba3-347ceb6fd006 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:33.591359 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239382af-d546-497b-aba3-347ceb6fd006 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:33.591633 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239382af-d546-497b-aba3-347ceb6fd006 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:33.592354 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239382af-d546-497b-aba3-347ceb6fd006 None admin] RBAC: Adding query filter params (role.id=7cc7d3c85c794033b590117321e97ccf, scope.project.id=dbe5c492b05e40448942bb2500c185ee, user.id=8d7d537583c64b5cabe287be6875a478) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:33.592652 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239382af-d546-497b-aba3-347ceb6fd006 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:33.594105 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239382af-d546-497b-aba3-347ceb6fd006 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:33.600395 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 455/908] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Sep 27 09:42:33 2022] GET /identity/v3/role_assignments?user.id=8d7d537583c64b5cabe287be6875a478&scope.project.id=dbe5c492b05e40448942bb2500c185ee&role.id=7cc7d3c85c794033b590117321e97ccf => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:42:36.031866 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15497acd-ef75-4130-8158-5c66a6a17aa6 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:36.032498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15497acd-ef75-4130-8158-5c66a6a17aa6 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:36.032498 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15497acd-ef75-4130-8158-5c66a6a17aa6 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:36.033802 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 454/909] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:42:36.040838 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576a588-bc8c-45e5-aeb8-63c3ac7cdf67 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:36.041439 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576a588-bc8c-45e5-aeb8-63c3ac7cdf67 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:36.041439 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576a588-bc8c-45e5-aeb8-63c3ac7cdf67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:36.062327 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-4576a588-bc8c-45e5-aeb8-63c3ac7cdf67 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:42:36.063605 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-4576a588-bc8c-45e5-aeb8-63c3ac7cdf67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:42:36.099160 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:36.148397 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 456/910] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:42:36 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 09:42:36.475901 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15497acd-ef75-4130-8158-5c66a6a17aa6 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:36.581267 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15497acd-ef75-4130-8158-5c66a6a17aa6 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:36.589879 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:36.620075 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac424d1-90a3-48a4-9e2d-9a17b909b1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:36.620705 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac424d1-90a3-48a4-9e2d-9a17b909b1d1 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:36.620975 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac424d1-90a3-48a4-9e2d-9a17b909b1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:36.621235 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac424d1-90a3-48a4-9e2d-9a17b909b1d1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:36.621839 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac424d1-90a3-48a4-9e2d-9a17b909b1d1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:36.623241 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac424d1-90a3-48a4-9e2d-9a17b909b1d1 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:36.632114 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-5ac424d1-90a3-48a4-9e2d-9a17b909b1d1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 09:42:36.632114 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:36.632114 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 09:42:36.632114 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 09:42:36.632114 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 09:42:36.632114 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 09:42:36.632114 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 09:42:36.632114 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:42:36.632114 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 09:42:36.632114 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:42:36.632114 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 09:42:36.632114 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:42:36.632114 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:36.632114 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:36.632114 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:36.632114 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:36.632114 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:36.633273 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:36.633273 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:36.633273 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:36.633273 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:36.633273 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:36.633273 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:36.633273 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 09:42:36.633273 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 09:42:36.633273 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 09:42:36.633273 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 09:42:36.633273 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:36.633273 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:36.633273 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:36.633273 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:36.633273 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:36.633273 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:36.634408 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:36.634408 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:36.634408 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:36.634408 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:36.634408 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:36.634408 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:36.634408 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:36.634408 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:36.634408 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:36.634408 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:36.634408 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 09:42:36.634408 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:42:36.634408 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 09:42:36.634408 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:42:36.638177 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 455/911] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Sep 27 09:42:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:36.639428 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576a588-bc8c-45e5-aeb8-63c3ac7cdf67 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:36.744303 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576a588-bc8c-45e5-aeb8-63c3ac7cdf67 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:36.780612 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43177ee5-cf33-41c2-8d27-ca9d1cdf02c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:36.781230 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43177ee5-cf33-41c2-8d27-ca9d1cdf02c6 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:36.781530 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43177ee5-cf33-41c2-8d27-ca9d1cdf02c6 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:36.781808 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43177ee5-cf33-41c2-8d27-ca9d1cdf02c6 None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:36.782447 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43177ee5-cf33-41c2-8d27-ca9d1cdf02c6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:36.782747 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43177ee5-cf33-41c2-8d27-ca9d1cdf02c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:36.784195 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43177ee5-cf33-41c2-8d27-ca9d1cdf02c6 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:36.790932 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 457/912] 10.222.0.49 () {56 vars in 1116 bytes} [Tue Sep 27 09:42:36 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:42:36.796939 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac424d1-90a3-48a4-9e2d-9a17b909b1d1 None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:36.904346 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac424d1-90a3-48a4-9e2d-9a17b909b1d1 None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:36.939911 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3636c-df89-4ee3-ab9d-8c96b5813c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:36.940513 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3636c-df89-4ee3-ab9d-8c96b5813c19 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:36.940790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3636c-df89-4ee3-ab9d-8c96b5813c19 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:36.941058 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3636c-df89-4ee3-ab9d-8c96b5813c19 None admin] PATH_INFO: `/v3/services` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:36.941828 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef3636c-df89-4ee3-ab9d-8c96b5813c19 None admin] RBAC: Adding query filter params (type=placement) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:36.942155 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef3636c-df89-4ee3-ab9d-8c96b5813c19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:36.943546 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef3636c-df89-4ee3-ab9d-8c96b5813c19 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:36.948180 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 456/913] 10.222.0.49 () {56 vars in 1116 bytes} [Tue Sep 27 09:42:36 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:39.314257 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b1928-8af9-4d35-9637-e3ecfe1ab0a3 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:39.314882 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b1928-8af9-4d35-9637-e3ecfe1ab0a3 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:39.314882 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b1928-8af9-4d35-9637-e3ecfe1ab0a3 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:39.316205 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 458/914] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:42:39.322353 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c04f86-48a6-48d7-ae91-923f2a58ae5f None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:39.322957 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c04f86-48a6-48d7-ae91-923f2a58ae5f None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:39.322957 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c04f86-48a6-48d7-ae91-923f2a58ae5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:39.343483 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-e5c04f86-48a6-48d7-ae91-923f2a58ae5f None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:42:39.344692 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-e5c04f86-48a6-48d7-ae91-923f2a58ae5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:42:39.376240 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:39.421200 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 457/915] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:42:39 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 09:42:39.740322 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b1928-8af9-4d35-9637-e3ecfe1ab0a3 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:39.774087 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:39.858001 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b1928-8af9-4d35-9637-e3ecfe1ab0a3 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:39.893645 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2802106-6c64-44d7-ad4e-83defa7ddebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:39.894271 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2802106-6c64-44d7-ad4e-83defa7ddebb None admin] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:39.894601 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2802106-6c64-44d7-ad4e-83defa7ddebb None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:39.895384 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2802106-6c64-44d7-ad4e-83defa7ddebb None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:39.896049 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2802106-6c64-44d7-ad4e-83defa7ddebb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:39.897409 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2802106-6c64-44d7-ad4e-83defa7ddebb None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:39.917217 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 459/916] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Sep 27 09:42:39 2022] POST /identity/v3/services => generated 246 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:42:42.307406 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d16fc-23b6-424d-ae66-6a3b3bcba515 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:42.308012 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d16fc-23b6-424d-ae66-6a3b3bcba515 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:42.308012 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d16fc-23b6-424d-ae66-6a3b3bcba515 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:42.309298 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 458/917] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:42:42.314605 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626abfe-959f-40e0-88db-121238ee87c6 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:42.315099 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626abfe-959f-40e0-88db-121238ee87c6 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:42.315208 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626abfe-959f-40e0-88db-121238ee87c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:42.335083 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-8626abfe-959f-40e0-88db-121238ee87c6 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:42:42.336307 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-8626abfe-959f-40e0-88db-121238ee87c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:42:42.414503 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 460/918] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:42:42 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 09:42:42.737632 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d16fc-23b6-424d-ae66-6a3b3bcba515 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:42.848396 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d16fc-23b6-424d-ae66-6a3b3bcba515 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:42.888862 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bc2f8-307d-4063-a282-a2004b98deeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:42.889490 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bc2f8-307d-4063-a282-a2004b98deeb None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:42.889760 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bc2f8-307d-4063-a282-a2004b98deeb None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:42.890025 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bc2f8-307d-4063-a282-a2004b98deeb None admin] PATH_INFO: `/v3/services/placement` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:42.890606 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bc2f8-307d-4063-a282-a2004b98deeb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:42.892014 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bc2f8-307d-4063-a282-a2004b98deeb None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:42.901853 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-ac9bc2f8-307d-4063-a282-a2004b98deeb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 09:42:42.901853 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:42.901853 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 09:42:42.901853 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 09:42:42.901853 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 09:42:42.901853 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 09:42:42.901853 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 09:42:42.901853 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:42:42.901853 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 09:42:42.901853 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:42:42.901853 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 09:42:42.901853 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:42:42.901853 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:42.901853 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:42.901853 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:42.901853 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:42.901853 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:42.903132 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:42.903132 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:42.903132 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:42.903132 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:42.903132 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:42.903132 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:42.903132 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 09:42:42.903132 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 09:42:42.903132 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 09:42:42.903132 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 09:42:42.903132 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:42.903132 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:42.903132 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:42.903132 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:42.903132 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:42.903132 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:42.904076 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:42.904076 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:42.904076 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:42.904076 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:42.904076 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:42.904076 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:42.904076 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:42.904076 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:42.904076 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:42.904076 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:42.904076 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 09:42:42.904076 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:42:42.904076 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 09:42:42.904076 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:42:42.904076 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 459/919] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Sep 27 09:42:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:42.909479 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626abfe-959f-40e0-88db-121238ee87c6 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:42.931595 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:43.023130 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626abfe-959f-40e0-88db-121238ee87c6 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:43.061394 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c8705-f170-4bd4-9624-69bd17afdd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:43.062019 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c8705-f170-4bd4-9624-69bd17afdd85 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:43.062291 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c8705-f170-4bd4-9624-69bd17afdd85 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:43.062559 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c8705-f170-4bd4-9624-69bd17afdd85 None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:43.063236 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c8705-f170-4bd4-9624-69bd17afdd85 None admin] RBAC: Adding query filter params (name=placement) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:43.063538 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c8705-f170-4bd4-9624-69bd17afdd85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:43.064930 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c8705-f170-4bd4-9624-69bd17afdd85 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:43.070809 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 461/920] 10.222.0.49 () {56 vars in 1116 bytes} [Tue Sep 27 09:42:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:43.077295 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bc2f8-307d-4063-a282-a2004b98deeb None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:43.109068 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:43.208405 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bc2f8-307d-4063-a282-a2004b98deeb None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:43.243542 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4513942-c1a4-4346-a0ac-e72d5f59a6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:43.244138 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4513942-c1a4-4346-a0ac-e72d5f59a6a4 None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:43.244406 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4513942-c1a4-4346-a0ac-e72d5f59a6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:43.244674 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4513942-c1a4-4346-a0ac-e72d5f59a6a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:43.245362 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4513942-c1a4-4346-a0ac-e72d5f59a6a4 None admin] RBAC: Adding query filter params (interface=public, service_id=18f22848a76f4751a4c3596d35de783c, region_id=RegionOne) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:43.245662 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4513942-c1a4-4346-a0ac-e72d5f59a6a4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:43.247052 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4513942-c1a4-4346-a0ac-e72d5f59a6a4 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:43.252153 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 460/921] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Sep 27 09:42:43 2022] GET /identity/v3/endpoints?service_id=18f22848a76f4751a4c3596d35de783c&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:43.258428 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c8705-f170-4bd4-9624-69bd17afdd85 None admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:43.342646 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:43.360969 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c8705-f170-4bd4-9624-69bd17afdd85 None admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:43.395781 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916adb2-002f-4ba0-bd82-4f02c5fa0a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:43.396393 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916adb2-002f-4ba0-bd82-4f02c5fa0a29 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:43.396671 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916adb2-002f-4ba0-bd82-4f02c5fa0a29 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:43.396939 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916adb2-002f-4ba0-bd82-4f02c5fa0a29 None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:43.397540 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916adb2-002f-4ba0-bd82-4f02c5fa0a29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:43.398964 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916adb2-002f-4ba0-bd82-4f02c5fa0a29 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:43.405547 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 462/922] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Sep 27 09:42:43 2022] GET /identity/v3/services => generated 1962 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 09:42:45.802863 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327bddb5-a4c5-45b8-bb0e-04768d4a9f40 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:45.803452 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327bddb5-a4c5-45b8-bb0e-04768d4a9f40 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:45.803452 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327bddb5-a4c5-45b8-bb0e-04768d4a9f40 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:45.804760 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 461/923] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:42:45.810205 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07bd7d-cfdc-4bef-b0a6-8d9c421e5d72 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:45.810644 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07bd7d-cfdc-4bef-b0a6-8d9c421e5d72 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:45.810745 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07bd7d-cfdc-4bef-b0a6-8d9c421e5d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:45.830650 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-de07bd7d-cfdc-4bef-b0a6-8d9c421e5d72 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:42:45.831935 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-de07bd7d-cfdc-4bef-b0a6-8d9c421e5d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:42:45.907948 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 463/924] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:42:45 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 09:42:46.226501 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327bddb5-a4c5-45b8-bb0e-04768d4a9f40 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:46.333670 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:46.346527 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327bddb5-a4c5-45b8-bb0e-04768d4a9f40 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:46.386755 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359205b-8457-4851-9417-fad6468d62cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:46.387523 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359205b-8457-4851-9417-fad6468d62cc None admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:46.387799 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359205b-8457-4851-9417-fad6468d62cc None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:46.388048 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359205b-8457-4851-9417-fad6468d62cc None admin] PATH_INFO: `/v3/services/placement` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:46.388670 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359205b-8457-4851-9417-fad6468d62cc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:46.390071 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359205b-8457-4851-9417-fad6468d62cc None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:46.400099 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application [None req-2359205b-8457-4851-9417-fad6468d62cc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 09:42:46.400099 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:46.400099 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 09:42:46.400099 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 09:42:46.400099 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 09:42:46.400099 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 09:42:46.400099 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 09:42:46.400099 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:42:46.400099 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 09:42:46.400099 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:42:46.400099 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 09:42:46.400099 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:42:46.400099 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 09:42:46.400099 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 09:42:46.400099 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 09:42:46.400099 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 09:42:46.400099 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 09:42:46.401275 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 09:42:46.401275 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 09:42:46.401275 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 09:42:46.401275 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 09:42:46.401275 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 09:42:46.401275 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 09:42:46.401275 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 09:42:46.401275 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 09:42:46.401275 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 09:42:46.401275 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 09:42:46.401275 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 09:42:46.401275 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 09:42:46.401275 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 09:42:46.401275 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 09:42:46.401275 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 09:42:46.401275 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 09:42:46.402105 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 09:42:46.402105 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application with Lock( Sep 27 09:42:46.402105 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 09:42:46.402105 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self._enter() Sep 27 09:42:46.402105 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 09:42:46.402105 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 09:42:46.402105 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 09:42:46.402105 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application return self.creator() Sep 27 09:42:46.402105 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 09:42:46.402105 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application created_value = creator( Sep 27 09:42:46.402105 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 09:42:46.402105 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 09:42:46.402105 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 09:42:46.402105 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: ERROR keystone.server.flask.application Sep 27 09:42:46.402105 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 462/925] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Sep 27 09:42:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 09:42:46.407697 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07bd7d-cfdc-4bef-b0a6-8d9c421e5d72 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:46.496856 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:46.526158 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07bd7d-cfdc-4bef-b0a6-8d9c421e5d72 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:46.565551 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3044e48-d70b-499d-80a2-5975322d4b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:46.566171 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3044e48-d70b-499d-80a2-5975322d4b97 None admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:46.566514 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3044e48-d70b-499d-80a2-5975322d4b97 None admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:46.566790 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3044e48-d70b-499d-80a2-5975322d4b97 None admin] PATH_INFO: `/v3/services` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:46.567444 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3044e48-d70b-499d-80a2-5975322d4b97 None admin] RBAC: Adding query filter params (name=placement) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:42:46.567739 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3044e48-d70b-499d-80a2-5975322d4b97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:46.569128 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3044e48-d70b-499d-80a2-5975322d4b97 None admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:46.575005 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 464/926] 10.222.0.49 () {56 vars in 1116 bytes} [Tue Sep 27 09:42:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:42:46.581192 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359205b-8457-4851-9417-fad6468d62cc None admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:42:46.693939 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359205b-8457-4851-9417-fad6468d62cc None admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:42:46.730202 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f2a44-ebbc-41bd-b1ba-1f63cfa9df65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:42:46.730841 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f2a44-ebbc-41bd-b1ba-1f63cfa9df65 None admin] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:42:46.731119 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f2a44-ebbc-41bd-b1ba-1f63cfa9df65 None admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:42:46.731387 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f2a44-ebbc-41bd-b1ba-1f63cfa9df65 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:42:46.732058 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f2a44-ebbc-41bd-b1ba-1f63cfa9df65 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:42:46.733424 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f2a44-ebbc-41bd-b1ba-1f63cfa9df65 None admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:42:46.756306 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 463/927] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 27 09:42:46 2022] POST /identity/v3/endpoints => generated 331 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:42:56.571587 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=30 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:42:56.751263 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:43:51.451367 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504164c-1841-4bf1-b0d9-db636516e823 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:43:51.451367 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504164c-1841-4bf1-b0d9-db636516e823 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:43:51.453171 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504164c-1841-4bf1-b0d9-db636516e823 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:43:51.458199 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 465/928] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:43:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:43:51.461408 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadcfe3-1314-4c11-b945-2bea5158168a None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:43:51.461868 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadcfe3-1314-4c11-b945-2bea5158168a None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:43:51.462129 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadcfe3-1314-4c11-b945-2bea5158168a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:43:51.496972 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-beadcfe3-1314-4c11-b945-2bea5158168a None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:43:51.498593 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-beadcfe3-1314-4c11-b945-2bea5158168a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:43:51.615362 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 464/929] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:43:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 09:43:51.966359 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d020b4-7194-4c15-bfe0-009d8573afbe None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:43:51.966748 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d020b4-7194-4c15-bfe0-009d8573afbe None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:43:51.967142 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d020b4-7194-4c15-bfe0-009d8573afbe None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:43:51.968704 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 466/930] 10.222.0.49 () {54 vars in 964 bytes} [Tue Sep 27 09:43:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:43:51.975512 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e38107-a133-4ff8-9812-5fa728f6e331 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:43:51.975873 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e38107-a133-4ff8-9812-5fa728f6e331 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:43:51.976266 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e38107-a133-4ff8-9812-5fa728f6e331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:43:52.048904 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-c4e38107-a133-4ff8-9812-5fa728f6e331 None None] MFA Rules not processed for user `5a8283aa6cda48fa9a6b2f42fc498238`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:43:52.050014 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-c4e38107-a133-4ff8-9812-5fa728f6e331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:43:52.117966 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 465/931] 10.222.0.49 () {58 vars in 1061 bytes} [Tue Sep 27 09:43:51 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 09:43:52.128237 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d020b4-7194-4c15-bfe0-009d8573afbe None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:43:52.141873 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d020b4-7194-4c15-bfe0-009d8573afbe None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:43:52.146801 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc46211-5ba2-494a-9f77-325294fdce5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:43:52.147547 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc46211-5ba2-494a-9f77-325294fdce5e service neutron] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:43:52.147880 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc46211-5ba2-494a-9f77-325294fdce5e service neutron] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:43:52.148284 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc46211-5ba2-494a-9f77-325294fdce5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:43:52.160520 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc46211-5ba2-494a-9f77-325294fdce5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:43:52.162323 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc46211-5ba2-494a-9f77-325294fdce5e service neutron] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:43:52.173358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 467/932] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:43:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:43:54.962315 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9dd82-6566-482f-b201-2338e8aa8dba None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:43:54.962889 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9dd82-6566-482f-b201-2338e8aa8dba None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:43:54.962889 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9dd82-6566-482f-b201-2338e8aa8dba None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:43:54.966417 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 466/933] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:43:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:43:54.975185 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3ea50-67f1-4525-af29-7dfe1ef5d957 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:43:54.975761 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3ea50-67f1-4525-af29-7dfe1ef5d957 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:43:54.975761 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3ea50-67f1-4525-af29-7dfe1ef5d957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:43:54.997148 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-cbc3ea50-67f1-4525-af29-7dfe1ef5d957 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:43:54.998480 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-cbc3ea50-67f1-4525-af29-7dfe1ef5d957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:43:55.008807 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 468/934] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:43:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:43:55.347911 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9dd82-6566-482f-b201-2338e8aa8dba None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:43:55.361311 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9dd82-6566-482f-b201-2338e8aa8dba None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:43:55.365843 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc5897-ae5e-4e36-9c8f-68140e05313b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:43:55.366915 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc5897-ae5e-4e36-9c8f-68140e05313b service neutron] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:43:55.367334 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc5897-ae5e-4e36-9c8f-68140e05313b service neutron] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:43:55.367602 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc5897-ae5e-4e36-9c8f-68140e05313b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:43:55.379359 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc5897-ae5e-4e36-9c8f-68140e05313b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:43:55.381253 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc5897-ae5e-4e36-9c8f-68140e05313b service neutron] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:43:55.394016 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 467/935] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:43:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:43:58.348739 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d090c56-6f96-4be0-97fc-e2cb9c907eef None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:43:58.348739 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d090c56-6f96-4be0-97fc-e2cb9c907eef None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:43:58.348739 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d090c56-6f96-4be0-97fc-e2cb9c907eef None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:43:58.348739 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 469/936] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:43:58.350129 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4c93f-f6f0-4f3f-9634-5141363ea318 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:43:58.350499 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4c93f-f6f0-4f3f-9634-5141363ea318 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:43:58.350820 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4c93f-f6f0-4f3f-9634-5141363ea318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:43:58.396219 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-eac4c93f-f6f0-4f3f-9634-5141363ea318 None None] MFA Rules not processed for user `2e0ed9493f0a42aca920506fd4534d15`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:43:58.397450 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-eac4c93f-f6f0-4f3f-9634-5141363ea318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:43:58.439837 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:43:58.472037 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 468/937] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:43:58 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:43:58.829343 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d090c56-6f96-4be0-97fc-e2cb9c907eef None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:43:58.843870 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d090c56-6f96-4be0-97fc-e2cb9c907eef None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:43:58.847766 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e6bda-7c4d-4539-b5a6-b7174d1f082c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:43:58.848430 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e6bda-7c4d-4539-b5a6-b7174d1f082c service neutron] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:43:58.848693 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e6bda-7c4d-4539-b5a6-b7174d1f082c service neutron] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:43:58.848952 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e6bda-7c4d-4539-b5a6-b7174d1f082c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:43:58.858707 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e6bda-7c4d-4539-b5a6-b7174d1f082c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:43:58.860099 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e6bda-7c4d-4539-b5a6-b7174d1f082c service neutron] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:43:58.869908 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 470/938] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:43:58 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:44:01.884510 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f4c8c-f847-4091-bf27-5b56eb420379 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:01.885153 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f4c8c-f847-4091-bf27-5b56eb420379 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:01.885153 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f4c8c-f847-4091-bf27-5b56eb420379 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:01.886400 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 469/939] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:44:01.891692 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a3177-4797-43c9-8e23-80cc96c4ec9e None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:01.892150 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a3177-4797-43c9-8e23-80cc96c4ec9e None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:01.892261 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a3177-4797-43c9-8e23-80cc96c4ec9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:01.911924 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-cb5a3177-4797-43c9-8e23-80cc96c4ec9e None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:44:01.913115 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-cb5a3177-4797-43c9-8e23-80cc96c4ec9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:44:01.981550 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 471/940] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:44:01 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:44:02.313576 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f4c8c-f847-4091-bf27-5b56eb420379 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:44:02.325872 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f4c8c-f847-4091-bf27-5b56eb420379 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:44:02.329834 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55c0b0-63d0-46bc-9c3e-7c9f4fb03089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:44:02.330430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55c0b0-63d0-46bc-9c3e-7c9f4fb03089 service neutron] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:02.330700 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55c0b0-63d0-46bc-9c3e-7c9f4fb03089 service neutron] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:02.330994 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55c0b0-63d0-46bc-9c3e-7c9f4fb03089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:02.340395 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55c0b0-63d0-46bc-9c3e-7c9f4fb03089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:44:02.341820 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55c0b0-63d0-46bc-9c3e-7c9f4fb03089 service neutron] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:44:02.351341 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 470/941] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:44:02 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:44:05.479800 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49994c27-7eae-4f1a-becb-a28cc9782324 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:05.480413 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49994c27-7eae-4f1a-becb-a28cc9782324 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:05.480413 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49994c27-7eae-4f1a-becb-a28cc9782324 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:05.481782 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 472/942] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:44:05.487340 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8a713-7e95-467f-b5ee-c6acc6f4fec2 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:05.487886 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8a713-7e95-467f-b5ee-c6acc6f4fec2 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:05.488000 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8a713-7e95-467f-b5ee-c6acc6f4fec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:05.510399 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-16d8a713-7e95-467f-b5ee-c6acc6f4fec2 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:44:05.511645 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-16d8a713-7e95-467f-b5ee-c6acc6f4fec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:44:05.520681 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 471/943] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:44:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:44:05.855056 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49994c27-7eae-4f1a-becb-a28cc9782324 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:44:05.867319 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49994c27-7eae-4f1a-becb-a28cc9782324 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:44:05.871768 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc3ba3-82bd-454e-8a63-799219fe0337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:44:05.872409 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc3ba3-82bd-454e-8a63-799219fe0337 service neutron] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:05.872680 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc3ba3-82bd-454e-8a63-799219fe0337 service neutron] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:05.872944 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc3ba3-82bd-454e-8a63-799219fe0337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:05.883317 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc3ba3-82bd-454e-8a63-799219fe0337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:44:05.884762 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc3ba3-82bd-454e-8a63-799219fe0337 service neutron] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:44:05.894461 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 473/944] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:44:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:44:08.361038 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750fe85-8c64-441e-820d-5b9783b4b422 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:08.361639 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750fe85-8c64-441e-820d-5b9783b4b422 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:08.361639 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750fe85-8c64-441e-820d-5b9783b4b422 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:08.362944 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 472/945] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:44:08.368358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91f62d-d51d-4005-923e-38830ffa9ffd None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:08.368823 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91f62d-d51d-4005-923e-38830ffa9ffd None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:08.368916 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91f62d-d51d-4005-923e-38830ffa9ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:08.389393 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-2a91f62d-d51d-4005-923e-38830ffa9ffd None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:44:08.390603 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-2a91f62d-d51d-4005-923e-38830ffa9ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:44:08.399146 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 474/946] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:44:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:44:08.741762 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04825e-0bea-42bb-8bf3-197368b3b7c7 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:08.742137 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04825e-0bea-42bb-8bf3-197368b3b7c7 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:08.742473 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04825e-0bea-42bb-8bf3-197368b3b7c7 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:08.743935 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 473/947] 10.222.0.49 () {54 vars in 964 bytes} [Tue Sep 27 09:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:44:08.750267 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc2977-306c-48e8-bdae-dc3932876b93 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:08.750551 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc2977-306c-48e8-bdae-dc3932876b93 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:08.750855 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc2977-306c-48e8-bdae-dc3932876b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:08.773019 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-51dc2977-306c-48e8-bdae-dc3932876b93 None None] MFA Rules not processed for user `5a8283aa6cda48fa9a6b2f42fc498238`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:44:08.774231 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-51dc2977-306c-48e8-bdae-dc3932876b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:44:08.781813 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 475/948] 10.222.0.49 () {58 vars in 1061 bytes} [Tue Sep 27 09:44:08 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:44:08.791447 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04825e-0bea-42bb-8bf3-197368b3b7c7 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:44:08.803315 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04825e-0bea-42bb-8bf3-197368b3b7c7 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:44:08.807487 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965df26-e241-47c0-9b10-02190e9818c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:44:08.808083 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965df26-e241-47c0-9b10-02190e9818c8 service neutron] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:08.808357 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965df26-e241-47c0-9b10-02190e9818c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:08.808621 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965df26-e241-47c0-9b10-02190e9818c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:08.817922 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965df26-e241-47c0-9b10-02190e9818c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:44:08.819390 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965df26-e241-47c0-9b10-02190e9818c8 service neutron] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:44:08.829284 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 474/949] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:44:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:44:11.501852 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007509c5-0c9d-4481-b1fc-0d60f8c1b542 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:11.502465 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007509c5-0c9d-4481-b1fc-0d60f8c1b542 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:11.502465 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007509c5-0c9d-4481-b1fc-0d60f8c1b542 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:11.503740 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 476/950] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:44:11.509602 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6e5c2-efc7-47be-b4c2-5e779668ccb0 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:11.510100 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6e5c2-efc7-47be-b4c2-5e779668ccb0 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:11.510193 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6e5c2-efc7-47be-b4c2-5e779668ccb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:11.530913 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-85b6e5c2-efc7-47be-b4c2-5e779668ccb0 None None] MFA Rules not processed for user `2e0ed9493f0a42aca920506fd4534d15`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:44:11.532116 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-85b6e5c2-efc7-47be-b4c2-5e779668ccb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:44:11.540897 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 475/951] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:44:11 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:44:11.872648 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007509c5-0c9d-4481-b1fc-0d60f8c1b542 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:44:11.884290 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007509c5-0c9d-4481-b1fc-0d60f8c1b542 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:44:11.888152 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ce819-e442-4640-bed3-2d75677a593d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:44:11.888767 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ce819-e442-4640-bed3-2d75677a593d service neutron] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:11.889037 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ce819-e442-4640-bed3-2d75677a593d service neutron] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:11.889299 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ce819-e442-4640-bed3-2d75677a593d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:11.898791 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ce819-e442-4640-bed3-2d75677a593d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:44:11.900235 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ce819-e442-4640-bed3-2d75677a593d service neutron] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:44:11.910154 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 477/952] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:44:11 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:44:14.592257 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae339e5c-a03b-43f5-8fa7-27d27ca8841d None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:14.592727 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae339e5c-a03b-43f5-8fa7-27d27ca8841d None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:14.592815 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae339e5c-a03b-43f5-8fa7-27d27ca8841d None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:14.594239 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 476/953] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:44:14.599903 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb1716-ad55-4645-9d8f-6999f6032966 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:14.606540 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb1716-ad55-4645-9d8f-6999f6032966 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:14.606540 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb1716-ad55-4645-9d8f-6999f6032966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:14.621912 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-e0cb1716-ad55-4645-9d8f-6999f6032966 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:44:14.623154 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-e0cb1716-ad55-4645-9d8f-6999f6032966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:44:14.632740 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 478/954] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:44:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:44:14.963944 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae339e5c-a03b-43f5-8fa7-27d27ca8841d None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:44:14.980666 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae339e5c-a03b-43f5-8fa7-27d27ca8841d None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:44:14.987979 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84e811-6243-428f-a474-671eba701c24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:44:14.988617 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84e811-6243-428f-a474-671eba701c24 service neutron] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:14.988970 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84e811-6243-428f-a474-671eba701c24 service neutron] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:14.989235 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84e811-6243-428f-a474-671eba701c24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:15.002178 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84e811-6243-428f-a474-671eba701c24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:44:15.003696 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84e811-6243-428f-a474-671eba701c24 service neutron] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:44:15.015172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 477/955] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:44:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:44:17.578293 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceefbaa-7639-4f8d-b8ba-29276a63badd None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:17.578928 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceefbaa-7639-4f8d-b8ba-29276a63badd None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:17.578928 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceefbaa-7639-4f8d-b8ba-29276a63badd None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:17.580152 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 479/956] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:44:17.586873 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe89845-f532-43c9-b3a9-548acf91efaf None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:17.587339 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe89845-f532-43c9-b3a9-548acf91efaf None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:17.587429 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe89845-f532-43c9-b3a9-548acf91efaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:17.609402 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-cbe89845-f532-43c9-b3a9-548acf91efaf None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:44:17.610699 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-cbe89845-f532-43c9-b3a9-548acf91efaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:44:17.621084 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 478/957] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:44:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:44:17.967300 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceefbaa-7639-4f8d-b8ba-29276a63badd None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:44:17.973605 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=68 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:44:17.980385 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceefbaa-7639-4f8d-b8ba-29276a63badd None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:44:17.984072 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22babc78-1709-4bd7-9df8-68453975ee19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:44:17.984668 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22babc78-1709-4bd7-9df8-68453975ee19 service neutron] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:17.984935 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22babc78-1709-4bd7-9df8-68453975ee19 service neutron] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:17.985197 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22babc78-1709-4bd7-9df8-68453975ee19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:17.994854 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22babc78-1709-4bd7-9df8-68453975ee19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:44:17.996287 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22babc78-1709-4bd7-9df8-68453975ee19 service neutron] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:44:18.006243 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 480/958] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:44:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:44:21.022309 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d40ee-67fa-46b3-b2fb-f121e2386f27 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:21.022944 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d40ee-67fa-46b3-b2fb-f121e2386f27 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:21.022944 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d40ee-67fa-46b3-b2fb-f121e2386f27 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:21.024362 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 479/959] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:44:21.034789 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df043de-4fa0-4677-9ad6-9db84f440e3f None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:21.035356 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df043de-4fa0-4677-9ad6-9db84f440e3f None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:21.035778 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df043de-4fa0-4677-9ad6-9db84f440e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:21.058894 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-7df043de-4fa0-4677-9ad6-9db84f440e3f None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:44:21.060848 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-7df043de-4fa0-4677-9ad6-9db84f440e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:44:21.072749 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 481/960] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:44:21 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:44:21.413588 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d40ee-67fa-46b3-b2fb-f121e2386f27 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:44:21.426412 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d40ee-67fa-46b3-b2fb-f121e2386f27 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:44:21.430138 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6a11f-9936-477f-814f-b8457d54df51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:44:21.430782 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6a11f-9936-477f-814f-b8457d54df51 service neutron] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:21.431055 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6a11f-9936-477f-814f-b8457d54df51 service neutron] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:21.431318 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6a11f-9936-477f-814f-b8457d54df51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:21.442556 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6a11f-9936-477f-814f-b8457d54df51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:44:21.444312 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6a11f-9936-477f-814f-b8457d54df51 service neutron] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:44:21.456180 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 480/961] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:44:21 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:44:26.658573 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55378c-3aa9-496d-b456-acfbdac9febb None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:26.659570 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55378c-3aa9-496d-b456-acfbdac9febb None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:26.660061 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55378c-3aa9-496d-b456-acfbdac9febb None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:26.668001 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d1ac1-d350-4a4e-a76f-c31c127a3a15 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:26.668986 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d1ac1-d350-4a4e-a76f-c31c127a3a15 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:26.669459 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d1ac1-d350-4a4e-a76f-c31c127a3a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:26.672787 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 482/962] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:44:26 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:44:26.691107 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-e89d1ac1-d350-4a4e-a76f-c31c127a3a15 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:44:26.692845 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-e89d1ac1-d350-4a4e-a76f-c31c127a3a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:44:26.706064 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 481/963] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:44:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:44:27.141670 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55378c-3aa9-496d-b456-acfbdac9febb None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:44:27.157573 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55378c-3aa9-496d-b456-acfbdac9febb None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:44:27.161920 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa2362-65c2-4ec6-bc8e-5019b693e108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:44:27.162540 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa2362-65c2-4ec6-bc8e-5019b693e108 service neutron] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:27.162854 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa2362-65c2-4ec6-bc8e-5019b693e108 service neutron] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:27.163126 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa2362-65c2-4ec6-bc8e-5019b693e108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:27.174368 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa2362-65c2-4ec6-bc8e-5019b693e108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:44:27.175979 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa2362-65c2-4ec6-bc8e-5019b693e108 service neutron] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:44:27.188951 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 483/964] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:44:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:44:30.571969 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf6b42-d02e-43b6-9858-9a7ea9aa08fb None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:30.572647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf6b42-d02e-43b6-9858-9a7ea9aa08fb None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:30.572647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf6b42-d02e-43b6-9858-9a7ea9aa08fb None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:30.573848 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 482/965] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:44:30.582571 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc032e-515e-4f98-babc-3f8f00423737 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:30.582571 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc032e-515e-4f98-babc-3f8f00423737 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:30.582571 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc032e-515e-4f98-babc-3f8f00423737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:30.600864 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-95dc032e-515e-4f98-babc-3f8f00423737 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:44:30.601707 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-95dc032e-515e-4f98-babc-3f8f00423737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:44:30.611924 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 484/966] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:44:30 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:44:30.950855 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf6b42-d02e-43b6-9858-9a7ea9aa08fb None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:44:30.956718 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=48 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:44:30.963769 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf6b42-d02e-43b6-9858-9a7ea9aa08fb None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:44:30.967557 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d5e29-8531-48fe-8008-125918a543dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:44:30.968256 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d5e29-8531-48fe-8008-125918a543dc service neutron] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:30.968537 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d5e29-8531-48fe-8008-125918a543dc service neutron] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:30.968806 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d5e29-8531-48fe-8008-125918a543dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:30.980181 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d5e29-8531-48fe-8008-125918a543dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:44:30.981867 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d5e29-8531-48fe-8008-125918a543dc service neutron] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:44:30.993594 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 483/967] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:44:30 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:44:35.707471 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cb9e8-9b23-42b3-9819-b020e1cb80f8 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:35.708347 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cb9e8-9b23-42b3-9819-b020e1cb80f8 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:35.708634 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cb9e8-9b23-42b3-9819-b020e1cb80f8 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:35.709969 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 485/968] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:44:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:44:35.715553 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40261928-daab-4994-950c-ccc0cda6cca9 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:35.716024 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40261928-daab-4994-950c-ccc0cda6cca9 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:35.716120 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40261928-daab-4994-950c-ccc0cda6cca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:35.737031 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-40261928-daab-4994-950c-ccc0cda6cca9 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:44:35.738271 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-40261928-daab-4994-950c-ccc0cda6cca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:44:35.747893 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 484/969] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:44:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:44:36.089432 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52cb9e8-9b23-42b3-9819-b020e1cb80f8 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:44:36.101444 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52cb9e8-9b23-42b3-9819-b020e1cb80f8 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:44:36.105027 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37bf41-d533-47fd-bc31-a000355b0e2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:44:36.105643 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37bf41-d533-47fd-bc31-a000355b0e2f service neutron] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:36.105914 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37bf41-d533-47fd-bc31-a000355b0e2f service neutron] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:36.106181 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37bf41-d533-47fd-bc31-a000355b0e2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:36.116416 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37bf41-d533-47fd-bc31-a000355b0e2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:44:36.117890 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37bf41-d533-47fd-bc31-a000355b0e2f service neutron] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:44:36.128320 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 486/970] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:44:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:44:41.868334 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac17006-f10d-4b16-a609-e140f8471c1c None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:41.868819 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac17006-f10d-4b16-a609-e140f8471c1c None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:41.868915 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac17006-f10d-4b16-a609-e140f8471c1c None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:41.870504 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 485/971] 10.222.0.49 () {54 vars in 921 bytes} [Tue Sep 27 09:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:44:41.877350 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aaa2c-3cce-4350-a32e-368bd369de5d None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:41.877798 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aaa2c-3cce-4350-a32e-368bd369de5d None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:41.878342 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aaa2c-3cce-4350-a32e-368bd369de5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:41.992115 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-988aaa2c-3cce-4350-a32e-368bd369de5d None None] MFA Rules not processed for user `8d7d537583c64b5cabe287be6875a478`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:44:41.994140 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-988aaa2c-3cce-4350-a32e-368bd369de5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:44:42.129474 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 487/972] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Sep 27 09:44:41 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:44:45.731630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=8 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:44:46.656629 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ef55c-678d-44c6-91d8-363e0f4167f4 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:46.657428 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ef55c-678d-44c6-91d8-363e0f4167f4 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:46.657428 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ef55c-678d-44c6-91d8-363e0f4167f4 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:46.659003 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 486/973] 10.222.0.49 () {54 vars in 921 bytes} [Tue Sep 27 09:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:44:46.666610 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54717f63-6de5-43e9-81c3-88e4b760c536 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:46.667173 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54717f63-6de5-43e9-81c3-88e4b760c536 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:46.667173 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54717f63-6de5-43e9-81c3-88e4b760c536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:46.695366 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-54717f63-6de5-43e9-81c3-88e4b760c536 None None] MFA Rules not processed for user `8d7d537583c64b5cabe287be6875a478`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:44:46.696661 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-54717f63-6de5-43e9-81c3-88e4b760c536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:44:46.710141 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 488/974] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Sep 27 09:44:46 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:44:48.464058 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889387a-e253-445c-bd57-d6d5c14ce97e None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:48.464651 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889387a-e253-445c-bd57-d6d5c14ce97e None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:48.464651 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889387a-e253-445c-bd57-d6d5c14ce97e None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:48.465906 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 487/975] 10.222.0.49 () {54 vars in 921 bytes} [Tue Sep 27 09:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:44:48.471606 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016f030-11b3-4711-9a64-745d3fd7c88d None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:48.472124 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016f030-11b3-4711-9a64-745d3fd7c88d None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:48.472276 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016f030-11b3-4711-9a64-745d3fd7c88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:48.480485 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=66 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:44:48.494910 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-c016f030-11b3-4711-9a64-745d3fd7c88d None None] MFA Rules not processed for user `8d7d537583c64b5cabe287be6875a478`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:44:48.496185 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-c016f030-11b3-4711-9a64-745d3fd7c88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:44:48.507632 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 489/976] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Sep 27 09:44:48 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:44:52.672250 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453e225-67b8-41f1-bf64-238565c23003 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:52.672250 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453e225-67b8-41f1-bf64-238565c23003 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:52.672250 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453e225-67b8-41f1-bf64-238565c23003 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:52.673733 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 488/977] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:44:52.685642 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f716874-9cb6-407d-a2e1-3b71f60c7463 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:52.686451 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f716874-9cb6-407d-a2e1-3b71f60c7463 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:52.686926 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f716874-9cb6-407d-a2e1-3b71f60c7463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:52.708872 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-7f716874-9cb6-407d-a2e1-3b71f60c7463 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:44:52.710348 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-7f716874-9cb6-407d-a2e1-3b71f60c7463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:44:52.719413 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 490/978] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:44:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:44:53.083482 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a0c47-15dc-45df-9e6e-9ca56fa3adde None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:53.083482 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a0c47-15dc-45df-9e6e-9ca56fa3adde None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:53.083482 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a0c47-15dc-45df-9e6e-9ca56fa3adde None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:53.086618 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 489/979] 10.222.0.49 () {54 vars in 961 bytes} [Tue Sep 27 09:44:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:44:53.095065 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe4420-5b12-4b97-aecd-a36da4a2b816 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:53.095781 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe4420-5b12-4b97-aecd-a36da4a2b816 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:53.096141 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe4420-5b12-4b97-aecd-a36da4a2b816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:53.153593 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-a2fe4420-5b12-4b97-aecd-a36da4a2b816 None None] MFA Rules not processed for user `bda026ed208d4736938da05121a06f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:44:53.154851 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-a2fe4420-5b12-4b97-aecd-a36da4a2b816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:44:53.271780 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 491/980] 10.222.0.49 () {58 vars in 1058 bytes} [Tue Sep 27 09:44:53 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:44:53.283612 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a0c47-15dc-45df-9e6e-9ca56fa3adde None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:44:53.303874 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a0c47-15dc-45df-9e6e-9ca56fa3adde None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:44:53.309416 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51f806-7142-4769-8748-a843c4302e72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:44:53.310022 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51f806-7142-4769-8748-a843c4302e72 service nova] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:53.310355 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51f806-7142-4769-8748-a843c4302e72 service nova] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:53.310678 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51f806-7142-4769-8748-a843c4302e72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:53.320102 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51f806-7142-4769-8748-a843c4302e72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:44:53.322010 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51f806-7142-4769-8748-a843c4302e72 service nova] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:44:53.334142 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 490/981] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:44:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:44:56.088316 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2d7e5-9ae0-4b34-87e2-3dd78df75670 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:56.089053 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2d7e5-9ae0-4b34-87e2-3dd78df75670 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:56.089053 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2d7e5-9ae0-4b34-87e2-3dd78df75670 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:56.090158 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 492/982] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:44:56.095984 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46094686-2918-4bc1-b38d-439c792185bb None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:56.096496 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46094686-2918-4bc1-b38d-439c792185bb None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:56.096496 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46094686-2918-4bc1-b38d-439c792185bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:56.117537 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-46094686-2918-4bc1-b38d-439c792185bb None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:44:56.118745 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-46094686-2918-4bc1-b38d-439c792185bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:44:56.127065 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 491/983] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:44:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 09:44:56.490994 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2d7e5-9ae0-4b34-87e2-3dd78df75670 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:44:56.509454 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2d7e5-9ae0-4b34-87e2-3dd78df75670 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:44:56.517343 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291bdd7-4ee1-4d20-90a0-4dc3e274cd47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:44:56.518066 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291bdd7-4ee1-4d20-90a0-4dc3e274cd47 service nova] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:56.518410 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291bdd7-4ee1-4d20-90a0-4dc3e274cd47 service nova] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:56.518932 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291bdd7-4ee1-4d20-90a0-4dc3e274cd47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:56.537991 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291bdd7-4ee1-4d20-90a0-4dc3e274cd47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:44:56.540246 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291bdd7-4ee1-4d20-90a0-4dc3e274cd47 service nova] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:44:56.555036 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 493/984] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:44:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:44:59.458514 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a890a75-696f-4a75-86dc-ff30e0793a6f None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:59.459211 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a890a75-696f-4a75-86dc-ff30e0793a6f None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:59.459211 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a890a75-696f-4a75-86dc-ff30e0793a6f None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:59.460575 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 492/985] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:44:59.466266 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2c039-4dd2-4618-a203-b4281b344ffa None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:59.466736 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2c039-4dd2-4618-a203-b4281b344ffa None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:59.467042 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2c039-4dd2-4618-a203-b4281b344ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:59.488314 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-d4b2c039-4dd2-4618-a203-b4281b344ffa None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:44:59.489579 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-d4b2c039-4dd2-4618-a203-b4281b344ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:44:59.497777 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 494/986] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:44:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:44:59.841833 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395caf8-6d85-4230-be78-c2a1c5aab6c4 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:59.842838 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395caf8-6d85-4230-be78-c2a1c5aab6c4 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:59.843309 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395caf8-6d85-4230-be78-c2a1c5aab6c4 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:59.844953 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 493/987] 10.222.0.49 () {54 vars in 961 bytes} [Tue Sep 27 09:44:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:44:59.852551 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ae772-638c-4c60-bc9e-dffb88a69836 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:59.852551 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ae772-638c-4c60-bc9e-dffb88a69836 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:59.852551 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ae772-638c-4c60-bc9e-dffb88a69836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:59.875134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-044ae772-638c-4c60-bc9e-dffb88a69836 None None] MFA Rules not processed for user `bda026ed208d4736938da05121a06f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:44:59.876154 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-044ae772-638c-4c60-bc9e-dffb88a69836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:44:59.884677 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 495/988] 10.222.0.49 () {58 vars in 1058 bytes} [Tue Sep 27 09:44:59 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:44:59.894419 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395caf8-6d85-4230-be78-c2a1c5aab6c4 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:44:59.911293 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395caf8-6d85-4230-be78-c2a1c5aab6c4 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:44:59.917895 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fda95-c0c7-4550-a9b7-9e5476b20d11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:44:59.918513 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fda95-c0c7-4550-a9b7-9e5476b20d11 service nova] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:44:59.918812 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fda95-c0c7-4550-a9b7-9e5476b20d11 service nova] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:44:59.919082 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fda95-c0c7-4550-a9b7-9e5476b20d11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:44:59.933441 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fda95-c0c7-4550-a9b7-9e5476b20d11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:44:59.935981 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fda95-c0c7-4550-a9b7-9e5476b20d11 service nova] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:44:59.949770 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 494/989] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:44:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:45:02.626983 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea1ab1-2a72-46f9-a67b-d954299301b5 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:02.627530 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea1ab1-2a72-46f9-a67b-d954299301b5 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:02.627634 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea1ab1-2a72-46f9-a67b-d954299301b5 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:02.633859 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 496/990] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:45:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:45:02.635082 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa8ca0-3522-46e9-b308-df7502ba4739 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:02.635924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa8ca0-3522-46e9-b308-df7502ba4739 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:02.636403 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa8ca0-3522-46e9-b308-df7502ba4739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:02.658346 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-8eaa8ca0-3522-46e9-b308-df7502ba4739 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:45:02.659958 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-8eaa8ca0-3522-46e9-b308-df7502ba4739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:45:02.668905 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 495/991] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:45:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 09:45:03.060059 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea1ab1-2a72-46f9-a67b-d954299301b5 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:45:03.076916 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea1ab1-2a72-46f9-a67b-d954299301b5 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:45:03.082819 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db43b9b-339b-4f77-b22d-8d7ed7860e45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:45:03.084137 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db43b9b-339b-4f77-b22d-8d7ed7860e45 service nova] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:03.084640 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db43b9b-339b-4f77-b22d-8d7ed7860e45 service nova] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:03.085132 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db43b9b-339b-4f77-b22d-8d7ed7860e45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:03.095280 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db43b9b-339b-4f77-b22d-8d7ed7860e45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:45:03.097281 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db43b9b-339b-4f77-b22d-8d7ed7860e45 service nova] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:45:03.120604 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 497/992] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:45:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:45:03.632902 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a646c64-74fa-4d93-b1d8-9634fb0ab3ab None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:03.633375 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a646c64-74fa-4d93-b1d8-9634fb0ab3ab None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:03.633745 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a646c64-74fa-4d93-b1d8-9634fb0ab3ab None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:03.643278 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85704f52-550e-4272-a36a-e648a231df44 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:03.643779 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85704f52-550e-4272-a36a-e648a231df44 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:03.644034 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85704f52-550e-4272-a36a-e648a231df44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:03.646593 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 496/993] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:45:03 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:45:03.687971 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-85704f52-550e-4272-a36a-e648a231df44 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:45:03.691264 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-85704f52-550e-4272-a36a-e648a231df44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:45:03.711622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 498/994] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:45:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:45:04.145762 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e4ba8-9df1-491c-92cc-eb4047c2ee27 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:04.146349 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e4ba8-9df1-491c-92cc-eb4047c2ee27 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:04.146673 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e4ba8-9df1-491c-92cc-eb4047c2ee27 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:04.148262 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 497/995] 10.222.0.49 () {54 vars in 963 bytes} [Tue Sep 27 09:45:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:45:04.155275 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0a74a-f587-4370-8870-3849da6823e6 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:04.155614 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0a74a-f587-4370-8870-3849da6823e6 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:04.155862 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0a74a-f587-4370-8870-3849da6823e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:04.202753 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-6ca0a74a-f587-4370-8870-3849da6823e6 None None] MFA Rules not processed for user `25ffb8d1c3014daab3b00e2a059af76b`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:45:04.204017 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-6ca0a74a-f587-4370-8870-3849da6823e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:45:04.280788 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 499/996] 10.222.0.49 () {58 vars in 1060 bytes} [Tue Sep 27 09:45:04 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:45:04.288562 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e4ba8-9df1-491c-92cc-eb4047c2ee27 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:45:04.300559 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e4ba8-9df1-491c-92cc-eb4047c2ee27 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:45:04.304406 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6c0b8-b1cd-41ea-8d37-944b4fb86067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25ffb8d1c3014daab3b00e2a059af76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:45:04.305142 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6c0b8-b1cd-41ea-8d37-944b4fb86067 service cinder] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:04.305414 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6c0b8-b1cd-41ea-8d37-944b4fb86067 service cinder] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:04.305738 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6c0b8-b1cd-41ea-8d37-944b4fb86067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:04.315817 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6c0b8-b1cd-41ea-8d37-944b4fb86067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:45:04.317616 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6c0b8-b1cd-41ea-8d37-944b4fb86067 service cinder] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:45:04.327907 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 498/997] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:45:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:45:05.866503 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844e87a-45be-4f86-beee-03b7c8508202 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:05.867191 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844e87a-45be-4f86-beee-03b7c8508202 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:05.867191 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844e87a-45be-4f86-beee-03b7c8508202 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:05.868984 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 500/998] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:45:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:45:05.876383 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab3a17-18b7-4fb1-a670-b8b020916b35 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:05.876973 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab3a17-18b7-4fb1-a670-b8b020916b35 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:05.877073 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab3a17-18b7-4fb1-a670-b8b020916b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:05.899438 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-f9ab3a17-18b7-4fb1-a670-b8b020916b35 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:45:05.900825 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-f9ab3a17-18b7-4fb1-a670-b8b020916b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:45:05.909952 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 499/999] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:45:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:45:06.271599 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844e87a-45be-4f86-beee-03b7c8508202 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:45:06.281627 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:45:06.288468 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844e87a-45be-4f86-beee-03b7c8508202 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:45:06.296302 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4cdc3-a6f6-4058-ab71-5146c411b172 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:45:06.296963 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4cdc3-a6f6-4058-ab71-5146c411b172 service nova] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:06.297209 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4cdc3-a6f6-4058-ab71-5146c411b172 service nova] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:06.297475 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4cdc3-a6f6-4058-ab71-5146c411b172 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:06.307372 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4cdc3-a6f6-4058-ab71-5146c411b172 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:45:06.309101 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4cdc3-a6f6-4058-ab71-5146c411b172 service nova] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:45:06.320778 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 501/1000] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:45:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:45:08.861456 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a9d3c-25ad-4fe0-894d-24119425afae None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:08.862304 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a9d3c-25ad-4fe0-894d-24119425afae None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:08.862741 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a9d3c-25ad-4fe0-894d-24119425afae None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:08.865009 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 500/1001] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:45:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:45:08.870755 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89a361-3b43-466e-bf13-d3725cdda9f4 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:08.871236 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89a361-3b43-466e-bf13-d3725cdda9f4 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:08.871334 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89a361-3b43-466e-bf13-d3725cdda9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:08.892433 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-aa89a361-3b43-466e-bf13-d3725cdda9f4 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:45:08.893621 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-aa89a361-3b43-466e-bf13-d3725cdda9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:45:08.902931 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 502/1002] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:45:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:45:09.258147 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a9d3c-25ad-4fe0-894d-24119425afae None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:45:09.273282 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a9d3c-25ad-4fe0-894d-24119425afae None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:45:09.278501 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1dd35-80e2-4064-a053-e8f2d524a6de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:45:09.279142 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1dd35-80e2-4064-a053-e8f2d524a6de service nova] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:09.279429 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1dd35-80e2-4064-a053-e8f2d524a6de service nova] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:09.279701 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1dd35-80e2-4064-a053-e8f2d524a6de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:09.289286 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1dd35-80e2-4064-a053-e8f2d524a6de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:45:09.290919 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1dd35-80e2-4064-a053-e8f2d524a6de service nova] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:45:09.304389 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 501/1003] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:45:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:45:11.784267 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d440b-301a-4e1c-a616-bfd4a6497822 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:11.784841 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d440b-301a-4e1c-a616-bfd4a6497822 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:11.784841 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d440b-301a-4e1c-a616-bfd4a6497822 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:11.786543 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 503/1004] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:45:11.793049 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57caf01c-755b-4dd2-8211-b35ccc6a47d8 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:11.793634 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57caf01c-755b-4dd2-8211-b35ccc6a47d8 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:11.793743 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57caf01c-755b-4dd2-8211-b35ccc6a47d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:11.814376 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-57caf01c-755b-4dd2-8211-b35ccc6a47d8 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:45:11.816126 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-57caf01c-755b-4dd2-8211-b35ccc6a47d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:45:11.824806 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 502/1005] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:45:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:45:12.168349 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d440b-301a-4e1c-a616-bfd4a6497822 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:45:12.182892 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d440b-301a-4e1c-a616-bfd4a6497822 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:45:12.187994 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee41e57-cf42-4d8f-af7c-a24dcc8e40e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:45:12.188688 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee41e57-cf42-4d8f-af7c-a24dcc8e40e5 service nova] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:12.189034 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee41e57-cf42-4d8f-af7c-a24dcc8e40e5 service nova] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:12.189391 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee41e57-cf42-4d8f-af7c-a24dcc8e40e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:12.198219 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee41e57-cf42-4d8f-af7c-a24dcc8e40e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:45:12.199962 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee41e57-cf42-4d8f-af7c-a24dcc8e40e5 service nova] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:45:12.211930 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 504/1006] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:45:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:45:14.856983 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52d410-c774-4266-a4d5-a74ac2bd05a1 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:14.857599 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52d410-c774-4266-a4d5-a74ac2bd05a1 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:14.857704 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52d410-c774-4266-a4d5-a74ac2bd05a1 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:14.859426 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 503/1007] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:45:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:45:14.865708 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad08046-b054-40aa-94f6-7c371fbfb93f None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:14.866293 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad08046-b054-40aa-94f6-7c371fbfb93f None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:14.866402 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad08046-b054-40aa-94f6-7c371fbfb93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:14.891835 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-bad08046-b054-40aa-94f6-7c371fbfb93f None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:45:14.893357 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-bad08046-b054-40aa-94f6-7c371fbfb93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:45:14.903982 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 505/1008] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:45:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:45:15.299690 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52d410-c774-4266-a4d5-a74ac2bd05a1 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:45:15.319194 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52d410-c774-4266-a4d5-a74ac2bd05a1 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:45:15.327154 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3b2e8-2d11-4b75-b012-9ebf6a6e1360 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:45:15.327809 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3b2e8-2d11-4b75-b012-9ebf6a6e1360 service nova] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:15.328111 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3b2e8-2d11-4b75-b012-9ebf6a6e1360 service nova] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:15.328458 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3b2e8-2d11-4b75-b012-9ebf6a6e1360 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:15.339098 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3b2e8-2d11-4b75-b012-9ebf6a6e1360 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:45:15.340838 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3b2e8-2d11-4b75-b012-9ebf6a6e1360 service nova] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:45:15.351775 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 504/1009] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:45:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:45:18.735622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a773c-470c-464f-932e-6a6d52637a0b None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:18.736307 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a773c-470c-464f-932e-6a6d52637a0b None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:18.736307 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a773c-470c-464f-932e-6a6d52637a0b None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:18.737476 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 506/1010] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:45:18.743212 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e6422-7e9f-4707-9d39-84cad1c6af1b None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:18.743789 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e6422-7e9f-4707-9d39-84cad1c6af1b None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:18.743789 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e6422-7e9f-4707-9d39-84cad1c6af1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:18.751919 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=43 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:45:18.766952 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-bf4e6422-7e9f-4707-9d39-84cad1c6af1b None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:45:18.768168 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-bf4e6422-7e9f-4707-9d39-84cad1c6af1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:45:18.776559 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 505/1011] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:45:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:45:19.110676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a773c-470c-464f-932e-6a6d52637a0b None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:45:19.127765 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a773c-470c-464f-932e-6a6d52637a0b None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:45:19.137144 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d478529-0f47-42a7-8c7d-193ac0403e56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:45:19.137823 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d478529-0f47-42a7-8c7d-193ac0403e56 service nova] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:19.138213 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d478529-0f47-42a7-8c7d-193ac0403e56 service nova] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:19.138542 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d478529-0f47-42a7-8c7d-193ac0403e56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:19.148663 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d478529-0f47-42a7-8c7d-193ac0403e56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:45:19.150261 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d478529-0f47-42a7-8c7d-193ac0403e56 service nova] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:45:19.160736 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 507/1012] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:45:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 09:45:20.768721 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba14265-36b6-4bea-bfd9-b010443ac324 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:20.769428 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba14265-36b6-4bea-bfd9-b010443ac324 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:20.769428 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba14265-36b6-4bea-bfd9-b010443ac324 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:20.771794 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 506/1013] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:45:20.777446 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30da0a-cb59-4f37-a6c4-dc35eb87317f None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:20.778038 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30da0a-cb59-4f37-a6c4-dc35eb87317f None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:20.778038 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30da0a-cb59-4f37-a6c4-dc35eb87317f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:20.798941 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-fc30da0a-cb59-4f37-a6c4-dc35eb87317f None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:45:20.800156 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-fc30da0a-cb59-4f37-a6c4-dc35eb87317f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:45:20.809172 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 508/1014] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:45:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:45:21.159511 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029834a-38cb-492d-8d5d-191c13cc4c03 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:21.159791 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029834a-38cb-492d-8d5d-191c13cc4c03 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:21.160061 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029834a-38cb-492d-8d5d-191c13cc4c03 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:21.161520 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 507/1015] 10.222.0.49 () {54 vars in 962 bytes} [Tue Sep 27 09:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:45:21.167519 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e5869-df2b-4174-81e0-085dd2fb2d33 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:21.167803 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e5869-df2b-4174-81e0-085dd2fb2d33 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:21.168077 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e5869-df2b-4174-81e0-085dd2fb2d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:21.211787 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-d78e5869-df2b-4174-81e0-085dd2fb2d33 None None] MFA Rules not processed for user `1575d436c7d043d886293e24fa5f64fb`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:45:21.213034 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-d78e5869-df2b-4174-81e0-085dd2fb2d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:45:21.286580 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 509/1016] 10.222.0.49 () {58 vars in 1059 bytes} [Tue Sep 27 09:45:21 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:45:21.294730 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029834a-38cb-492d-8d5d-191c13cc4c03 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:45:21.305976 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029834a-38cb-492d-8d5d-191c13cc4c03 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:45:21.309539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e04d2-1606-4e94-9313-fcc6aa1752da service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1575d436c7d043d886293e24fa5f64fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:45:21.310136 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e04d2-1606-4e94-9313-fcc6aa1752da service glance] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:21.310408 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e04d2-1606-4e94-9313-fcc6aa1752da service glance] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:21.310656 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e04d2-1606-4e94-9313-fcc6aa1752da service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:21.320009 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e04d2-1606-4e94-9313-fcc6aa1752da service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:45:21.321450 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e04d2-1606-4e94-9313-fcc6aa1752da service glance] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:45:21.330959 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 508/1017] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:45:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:45:21.649050 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b42254-c5c0-436d-9392-c4bdca9a0774 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:21.649356 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b42254-c5c0-436d-9392-c4bdca9a0774 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:21.649606 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b42254-c5c0-436d-9392-c4bdca9a0774 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:21.655229 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 510/1018] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:45:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:45:21.658505 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da86c99-3168-4d3b-94ae-5b2e2b2c8c43 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:21.659059 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da86c99-3168-4d3b-94ae-5b2e2b2c8c43 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:21.659530 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da86c99-3168-4d3b-94ae-5b2e2b2c8c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:21.692896 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-5da86c99-3168-4d3b-94ae-5b2e2b2c8c43 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:45:21.694142 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-5da86c99-3168-4d3b-94ae-5b2e2b2c8c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:45:21.703249 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 509/1019] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:45:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:45:22.048067 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b42254-c5c0-436d-9392-c4bdca9a0774 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:45:22.068798 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b42254-c5c0-436d-9392-c4bdca9a0774 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:45:22.074477 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab289ed-4372-4926-8dff-8e1812fa3dd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:45:22.075280 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab289ed-4372-4926-8dff-8e1812fa3dd4 service nova] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:22.075563 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab289ed-4372-4926-8dff-8e1812fa3dd4 service nova] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:22.075836 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab289ed-4372-4926-8dff-8e1812fa3dd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:22.086280 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab289ed-4372-4926-8dff-8e1812fa3dd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:45:22.091468 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab289ed-4372-4926-8dff-8e1812fa3dd4 service nova] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:45:22.100097 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 511/1020] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:45:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:45:24.708810 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f804613-65e1-4108-b74a-59035cf48ab8 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:24.709440 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f804613-65e1-4108-b74a-59035cf48ab8 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:24.709440 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f804613-65e1-4108-b74a-59035cf48ab8 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:24.712636 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 510/1021] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:45:24.716697 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce982fa-cb55-4c76-bd1d-02dd5679b14f None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:24.717259 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce982fa-cb55-4c76-bd1d-02dd5679b14f None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:24.717259 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce982fa-cb55-4c76-bd1d-02dd5679b14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:24.739116 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-bce982fa-cb55-4c76-bd1d-02dd5679b14f None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:45:24.739857 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-bce982fa-cb55-4c76-bd1d-02dd5679b14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:45:24.750220 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 512/1022] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:45:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:45:25.152327 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f804613-65e1-4108-b74a-59035cf48ab8 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:45:25.171487 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f804613-65e1-4108-b74a-59035cf48ab8 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:45:25.180586 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c95076-7968-4034-90f4-c95d65fb618e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:45:25.180586 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c95076-7968-4034-90f4-c95d65fb618e service nova] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:25.180586 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c95076-7968-4034-90f4-c95d65fb618e service nova] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:25.180586 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c95076-7968-4034-90f4-c95d65fb618e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:25.196469 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c95076-7968-4034-90f4-c95d65fb618e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:45:25.201309 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c95076-7968-4034-90f4-c95d65fb618e service nova] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:45:25.216719 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 511/1023] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:45:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:45:28.027495 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8065d1-f7c6-41bb-a7af-b64877b24181 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:28.028478 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8065d1-f7c6-41bb-a7af-b64877b24181 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:28.028478 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8065d1-f7c6-41bb-a7af-b64877b24181 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:28.030258 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 513/1024] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:45:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:45:28.036704 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5882bde-044e-4085-800a-d63c27585180 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:28.037611 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5882bde-044e-4085-800a-d63c27585180 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:28.037839 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5882bde-044e-4085-800a-d63c27585180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:28.063274 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-d5882bde-044e-4085-800a-d63c27585180 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:45:28.073268 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-d5882bde-044e-4085-800a-d63c27585180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:45:28.083961 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 512/1025] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:45:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:45:28.474789 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8065d1-f7c6-41bb-a7af-b64877b24181 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:45:28.508018 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8065d1-f7c6-41bb-a7af-b64877b24181 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:45:28.516055 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14221b2e-3a95-4918-9168-7589682afa19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:45:28.517075 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14221b2e-3a95-4918-9168-7589682afa19 service nova] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:28.517522 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14221b2e-3a95-4918-9168-7589682afa19 service nova] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:28.517967 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14221b2e-3a95-4918-9168-7589682afa19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:28.533538 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14221b2e-3a95-4918-9168-7589682afa19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:45:28.536528 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14221b2e-3a95-4918-9168-7589682afa19 service nova] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:45:28.554239 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 514/1026] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:45:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:45:37.872973 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f4f33-c46b-4dd8-bb0b-a25f4726870f None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:37.873550 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f4f33-c46b-4dd8-bb0b-a25f4726870f None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:37.873550 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f4f33-c46b-4dd8-bb0b-a25f4726870f None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:37.874799 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 513/1027] 10.222.0.49 () {54 vars in 918 bytes} [Tue Sep 27 09:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:45:37.880574 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b9efb-70dc-4b6f-a151-a3e43b538344 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:37.881227 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b9efb-70dc-4b6f-a151-a3e43b538344 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:37.881227 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b9efb-70dc-4b6f-a151-a3e43b538344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:37.889005 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=74 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:45:37.902557 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-ba6b9efb-70dc-4b6f-a151-a3e43b538344 None None] MFA Rules not processed for user `8d7d537583c64b5cabe287be6875a478`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:45:37.903813 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-ba6b9efb-70dc-4b6f-a151-a3e43b538344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:45:37.912901 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 515/1028] 10.222.0.49 () {58 vars in 1015 bytes} [Tue Sep 27 09:45:37 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 09:45:37.928517 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c731a-ebd1-4add-8b89-30c6fec94511 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:37.928787 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c731a-ebd1-4add-8b89-30c6fec94511 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:37.929057 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c731a-ebd1-4add-8b89-30c6fec94511 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:37.930413 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 514/1029] 10.222.0.49 () {54 vars in 918 bytes} [Tue Sep 27 09:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:45:37.935966 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92817ba-e89b-44d3-b184-ce98b68fda63 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:37.936297 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92817ba-e89b-44d3-b184-ce98b68fda63 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:37.936609 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92817ba-e89b-44d3-b184-ce98b68fda63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:37.958635 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-b92817ba-e89b-44d3-b184-ce98b68fda63 None None] MFA Rules not processed for user `bda026ed208d4736938da05121a06f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:45:37.959904 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-b92817ba-e89b-44d3-b184-ce98b68fda63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:45:37.969367 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 516/1030] 10.222.0.49 () {58 vars in 1015 bytes} [Tue Sep 27 09:45:37 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:45:38.054691 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=20 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:45:40.906662 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c035961-4684-4c0b-8fb3-8353c5a107c9 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:40.907352 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c035961-4684-4c0b-8fb3-8353c5a107c9 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:40.907447 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c035961-4684-4c0b-8fb3-8353c5a107c9 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:40.909816 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 515/1031] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 09:45:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:45:40.915587 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442747b2-fe7a-4005-b90d-931264535af6 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:40.916334 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442747b2-fe7a-4005-b90d-931264535af6 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:40.916334 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442747b2-fe7a-4005-b90d-931264535af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:40.936671 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-442747b2-fe7a-4005-b90d-931264535af6 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:45:40.937860 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-442747b2-fe7a-4005-b90d-931264535af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:45:40.946526 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 517/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 09:45:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:45:41.286808 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c035961-4684-4c0b-8fb3-8353c5a107c9 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:45:41.302850 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c035961-4684-4c0b-8fb3-8353c5a107c9 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:45:41.308620 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089c5af-1e9c-4e3d-8285-0da3d8ff5b6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:45:41.309229 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089c5af-1e9c-4e3d-8285-0da3d8ff5b6b service nova] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:41.309501 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089c5af-1e9c-4e3d-8285-0da3d8ff5b6b service nova] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:41.309768 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089c5af-1e9c-4e3d-8285-0da3d8ff5b6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:41.318396 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089c5af-1e9c-4e3d-8285-0da3d8ff5b6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:45:41.320042 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089c5af-1e9c-4e3d-8285-0da3d8ff5b6b service nova] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:45:41.329794 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 516/1033] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:45:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:45:43.131689 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0c7b0-ed42-4d39-bb30-6b19dffb7d0c None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:43.132311 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0c7b0-ed42-4d39-bb30-6b19dffb7d0c None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:43.132616 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0c7b0-ed42-4d39-bb30-6b19dffb7d0c None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:43.135003 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 518/1034] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 09:45:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:45:43.141664 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ace1d-222d-4740-9456-3cea4b407527 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:43.142306 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ace1d-222d-4740-9456-3cea4b407527 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:43.142306 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ace1d-222d-4740-9456-3cea4b407527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:43.162831 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-814ace1d-222d-4740-9456-3cea4b407527 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:45:43.164115 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-814ace1d-222d-4740-9456-3cea4b407527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:45:43.173609 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 517/1035] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 09:45:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:45:43.388532 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0c7b0-ed42-4d39-bb30-6b19dffb7d0c None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:45:43.403125 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0c7b0-ed42-4d39-bb30-6b19dffb7d0c None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:45:43.408649 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90222e0c-d6ee-4bd5-9d3c-545cc5df301c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:45:43.409262 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90222e0c-d6ee-4bd5-9d3c-545cc5df301c service nova] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:43.409534 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90222e0c-d6ee-4bd5-9d3c-545cc5df301c service nova] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:43.409800 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90222e0c-d6ee-4bd5-9d3c-545cc5df301c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:43.419736 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90222e0c-d6ee-4bd5-9d3c-545cc5df301c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:45:43.421395 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90222e0c-d6ee-4bd5-9d3c-545cc5df301c service nova] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:45:43.431356 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 519/1036] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:45:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:45:45.190414 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19eb17-8dc6-411c-aa0e-0fb1617c3934 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:45.191058 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19eb17-8dc6-411c-aa0e-0fb1617c3934 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:45.191058 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19eb17-8dc6-411c-aa0e-0fb1617c3934 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:45.192378 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 518/1037] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 09:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:45:45.197691 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447f371-0f09-4915-b92f-232df5cb8c5f None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:45.198140 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447f371-0f09-4915-b92f-232df5cb8c5f None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:45.198235 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447f371-0f09-4915-b92f-232df5cb8c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:45.219954 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-9447f371-0f09-4915-b92f-232df5cb8c5f None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:45:45.221174 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-9447f371-0f09-4915-b92f-232df5cb8c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:45:45.229730 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 520/1038] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 09:45:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:45:45.394303 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19eb17-8dc6-411c-aa0e-0fb1617c3934 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:45:45.409176 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19eb17-8dc6-411c-aa0e-0fb1617c3934 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:45:45.415243 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9dfddf-36ec-4c2c-bef2-9025f2b25ea6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:45:45.415634 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dfddf-36ec-4c2c-bef2-9025f2b25ea6 service nova] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:45.415912 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dfddf-36ec-4c2c-bef2-9025f2b25ea6 service nova] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:45.416298 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dfddf-36ec-4c2c-bef2-9025f2b25ea6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:45.425435 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9dfddf-36ec-4c2c-bef2-9025f2b25ea6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:45:45.427177 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9dfddf-36ec-4c2c-bef2-9025f2b25ea6 service nova] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:45:45.437156 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 519/1039] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:45:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:45:47.139769 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92f012-b683-4d8a-8399-b4d897fd9adc None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:47.140382 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92f012-b683-4d8a-8399-b4d897fd9adc None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:47.140382 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92f012-b683-4d8a-8399-b4d897fd9adc None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:47.141671 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 521/1040] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 09:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:45:47.147492 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d8c96-b4a6-4720-9d67-bca4f7b30976 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:47.148143 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d8c96-b4a6-4720-9d67-bca4f7b30976 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:47.148143 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d8c96-b4a6-4720-9d67-bca4f7b30976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:47.170512 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-cb8d8c96-b4a6-4720-9d67-bca4f7b30976 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:45:47.171794 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-cb8d8c96-b4a6-4720-9d67-bca4f7b30976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:45:47.184178 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 520/1041] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 09:45:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:45:47.354635 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92f012-b683-4d8a-8399-b4d897fd9adc None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:45:47.369928 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92f012-b683-4d8a-8399-b4d897fd9adc None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:45:47.376261 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb8781-fd9e-4ed7-8f63-21299d00ae3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:45:47.376882 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb8781-fd9e-4ed7-8f63-21299d00ae3a service nova] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:47.377155 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb8781-fd9e-4ed7-8f63-21299d00ae3a service nova] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:47.377445 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb8781-fd9e-4ed7-8f63-21299d00ae3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:47.387408 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb8781-fd9e-4ed7-8f63-21299d00ae3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:45:47.389417 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb8781-fd9e-4ed7-8f63-21299d00ae3a service nova] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:45:47.400739 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 522/1042] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:45:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:45:49.173569 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cac64-4f8d-4ab7-b447-6695efc6d0ac None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:49.174218 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cac64-4f8d-4ab7-b447-6695efc6d0ac None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:49.174218 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cac64-4f8d-4ab7-b447-6695efc6d0ac None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:49.175479 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 521/1043] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 09:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:45:49.181565 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175e688-2330-4292-a03c-62ee6ff1ca5e None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:49.182043 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175e688-2330-4292-a03c-62ee6ff1ca5e None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:49.182146 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175e688-2330-4292-a03c-62ee6ff1ca5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:49.203749 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-0175e688-2330-4292-a03c-62ee6ff1ca5e None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:45:49.205021 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-0175e688-2330-4292-a03c-62ee6ff1ca5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:45:49.214087 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 523/1044] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 09:45:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:45:49.375424 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cac64-4f8d-4ab7-b447-6695efc6d0ac None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:45:49.390014 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cac64-4f8d-4ab7-b447-6695efc6d0ac None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:45:49.395962 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96019ed-5b18-4ed5-a9f0-cfdc7f6fa447 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:45:49.396603 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96019ed-5b18-4ed5-a9f0-cfdc7f6fa447 service nova] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:49.396880 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96019ed-5b18-4ed5-a9f0-cfdc7f6fa447 service nova] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:49.397147 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96019ed-5b18-4ed5-a9f0-cfdc7f6fa447 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:49.406306 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96019ed-5b18-4ed5-a9f0-cfdc7f6fa447 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:45:49.408053 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96019ed-5b18-4ed5-a9f0-cfdc7f6fa447 service nova] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:45:49.419202 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 522/1045] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:45:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:45:51.049510 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5377bc-b453-4688-8760-10fe7adbddfd None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:51.050096 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5377bc-b453-4688-8760-10fe7adbddfd None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:51.050096 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5377bc-b453-4688-8760-10fe7adbddfd None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:51.051606 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 524/1046] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 09:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:45:51.057036 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d7b7c-3a8f-4dbc-b8ab-16fac6f3caf0 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:51.057554 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d7b7c-3a8f-4dbc-b8ab-16fac6f3caf0 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:51.057554 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d7b7c-3a8f-4dbc-b8ab-16fac6f3caf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:51.079886 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-7d7d7b7c-3a8f-4dbc-b8ab-16fac6f3caf0 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:45:51.081147 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-7d7d7b7c-3a8f-4dbc-b8ab-16fac6f3caf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:45:51.092270 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 523/1047] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 09:45:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:45:51.250438 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5377bc-b453-4688-8760-10fe7adbddfd None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:45:51.266929 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5377bc-b453-4688-8760-10fe7adbddfd None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:45:51.273063 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6511cd-5915-4860-be68-4b8407bd15dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:45:51.273675 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6511cd-5915-4860-be68-4b8407bd15dc service nova] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:51.273948 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6511cd-5915-4860-be68-4b8407bd15dc service nova] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:51.274203 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6511cd-5915-4860-be68-4b8407bd15dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:51.283682 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6511cd-5915-4860-be68-4b8407bd15dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:45:51.286139 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6511cd-5915-4860-be68-4b8407bd15dc service nova] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:45:51.296783 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 525/1048] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:45:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:45:52.916346 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511a9d1-c43b-4d33-91b2-66419544bb98 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:52.917250 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511a9d1-c43b-4d33-91b2-66419544bb98 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:52.917250 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511a9d1-c43b-4d33-91b2-66419544bb98 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:52.918490 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 524/1049] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 09:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:45:52.923811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962d1a1-afc1-40ee-8356-f6de8529ac1c None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:52.924321 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962d1a1-afc1-40ee-8356-f6de8529ac1c None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:52.924423 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962d1a1-afc1-40ee-8356-f6de8529ac1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:52.945199 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-5962d1a1-afc1-40ee-8356-f6de8529ac1c None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:45:52.946408 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-5962d1a1-afc1-40ee-8356-f6de8529ac1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:45:52.955046 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 526/1050] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 09:45:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:45:53.116975 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511a9d1-c43b-4d33-91b2-66419544bb98 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:45:53.131677 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511a9d1-c43b-4d33-91b2-66419544bb98 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:45:53.137230 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda7628-f9c2-483f-96cc-ba7a5e804523 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:45:53.137838 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda7628-f9c2-483f-96cc-ba7a5e804523 service nova] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:53.138107 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda7628-f9c2-483f-96cc-ba7a5e804523 service nova] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:53.138374 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda7628-f9c2-483f-96cc-ba7a5e804523 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:53.147686 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda7628-f9c2-483f-96cc-ba7a5e804523 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:45:53.149297 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda7628-f9c2-483f-96cc-ba7a5e804523 service nova] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:45:53.159469 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 525/1051] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:45:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:45:54.808339 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e488e4-e3b0-4e25-b1bd-00e1f763f038 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:54.808977 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e488e4-e3b0-4e25-b1bd-00e1f763f038 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:54.808977 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e488e4-e3b0-4e25-b1bd-00e1f763f038 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:54.810230 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 527/1052] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 09:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:45:54.816012 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6ef2f-e669-469f-bd03-50af7bdf6910 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:54.816699 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6ef2f-e669-469f-bd03-50af7bdf6910 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:54.816699 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6ef2f-e669-469f-bd03-50af7bdf6910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:54.838211 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-0eb6ef2f-e669-469f-bd03-50af7bdf6910 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:45:54.839367 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-0eb6ef2f-e669-469f-bd03-50af7bdf6910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:45:54.847928 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 526/1053] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 09:45:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:45:55.003726 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e488e4-e3b0-4e25-b1bd-00e1f763f038 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:45:55.019795 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e488e4-e3b0-4e25-b1bd-00e1f763f038 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:45:55.025176 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f44d0-af0c-4354-a181-671327578552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:45:55.025808 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f44d0-af0c-4354-a181-671327578552 service nova] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:55.026082 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f44d0-af0c-4354-a181-671327578552 service nova] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:55.026346 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f44d0-af0c-4354-a181-671327578552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:55.035548 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f44d0-af0c-4354-a181-671327578552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:45:55.037164 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f44d0-af0c-4354-a181-671327578552 service nova] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:45:55.047955 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 528/1054] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:45:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:45:56.681018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d061527-dcc6-470a-afa1-edea5d9881aa None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:56.681594 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d061527-dcc6-470a-afa1-edea5d9881aa None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:56.681594 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d061527-dcc6-470a-afa1-edea5d9881aa None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:56.682971 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 527/1055] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 09:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:45:56.688441 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9917d2-82eb-4dc9-87f9-c4e8cecd9b14 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:56.688921 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9917d2-82eb-4dc9-87f9-c4e8cecd9b14 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:56.688921 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9917d2-82eb-4dc9-87f9-c4e8cecd9b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:56.711047 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-2b9917d2-82eb-4dc9-87f9-c4e8cecd9b14 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:45:56.712283 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-2b9917d2-82eb-4dc9-87f9-c4e8cecd9b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:45:56.721052 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 529/1056] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 09:45:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:45:56.880504 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d061527-dcc6-470a-afa1-edea5d9881aa None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:45:56.895876 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d061527-dcc6-470a-afa1-edea5d9881aa None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:45:56.901878 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a566294-4ca9-4b1e-8c64-c73347fc94bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:45:56.902564 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a566294-4ca9-4b1e-8c64-c73347fc94bc service nova] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:56.903172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a566294-4ca9-4b1e-8c64-c73347fc94bc service nova] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:56.903450 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a566294-4ca9-4b1e-8c64-c73347fc94bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:56.913415 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a566294-4ca9-4b1e-8c64-c73347fc94bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:45:56.915061 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a566294-4ca9-4b1e-8c64-c73347fc94bc service nova] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:45:56.926180 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 528/1057] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:45:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:45:59.447532 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011e85e-d558-43d8-8913-53342651046c None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:59.448118 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011e85e-d558-43d8-8913-53342651046c None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:59.448460 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011e85e-d558-43d8-8913-53342651046c None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:59.450129 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 530/1058] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 09:45:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:45:59.456254 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d586104-ed14-49ec-95d1-392623d60528 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:59.456859 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d586104-ed14-49ec-95d1-392623d60528 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:59.456859 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d586104-ed14-49ec-95d1-392623d60528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:59.478219 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-5d586104-ed14-49ec-95d1-392623d60528 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:45:59.479482 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-5d586104-ed14-49ec-95d1-392623d60528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:45:59.487649 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 529/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 09:45:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:45:59.829099 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011e85e-d558-43d8-8913-53342651046c None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:45:59.841844 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011e85e-d558-43d8-8913-53342651046c None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:45:59.845945 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc898ae-538a-462f-a489-5387aa484e83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:45:59.846560 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc898ae-538a-462f-a489-5387aa484e83 service neutron] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:45:59.846869 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc898ae-538a-462f-a489-5387aa484e83 service neutron] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:45:59.847141 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc898ae-538a-462f-a489-5387aa484e83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:45:59.858176 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc898ae-538a-462f-a489-5387aa484e83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:45:59.859677 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc898ae-538a-462f-a489-5387aa484e83 service neutron] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:45:59.870469 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 531/1060] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:45:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:46:02.467410 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47fa22-ec74-445f-86e5-8d2fbcb60fb5 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:02.468025 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47fa22-ec74-445f-86e5-8d2fbcb60fb5 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:02.468025 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47fa22-ec74-445f-86e5-8d2fbcb60fb5 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:02.469278 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 530/1061] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 09:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:46:02.475189 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a7435-4883-4eca-ad73-700da15e82f9 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:02.475667 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a7435-4883-4eca-ad73-700da15e82f9 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:02.475777 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a7435-4883-4eca-ad73-700da15e82f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:02.495914 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-3e7a7435-4883-4eca-ad73-700da15e82f9 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:46:02.497133 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-3e7a7435-4883-4eca-ad73-700da15e82f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:46:02.506148 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 532/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 09:46:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:46:02.836210 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47fa22-ec74-445f-86e5-8d2fbcb60fb5 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:46:02.848413 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47fa22-ec74-445f-86e5-8d2fbcb60fb5 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:46:02.852842 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09086e-4372-42c2-88a2-cc7a0d701eed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:46:02.853453 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09086e-4372-42c2-88a2-cc7a0d701eed service neutron] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:02.853726 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09086e-4372-42c2-88a2-cc7a0d701eed service neutron] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:02.854064 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09086e-4372-42c2-88a2-cc7a0d701eed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:02.864310 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09086e-4372-42c2-88a2-cc7a0d701eed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:46:02.865737 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09086e-4372-42c2-88a2-cc7a0d701eed service neutron] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:46:02.875580 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 531/1063] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:46:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:46:05.621105 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f1686-f502-44d2-8e30-f41388ec087a None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:05.622007 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f1686-f502-44d2-8e30-f41388ec087a None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:05.622007 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f1686-f502-44d2-8e30-f41388ec087a None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:05.623579 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 533/1064] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 09:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:46:05.629585 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593cff2-9d1b-4772-b66b-2bd7a5c6c926 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:05.630068 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593cff2-9d1b-4772-b66b-2bd7a5c6c926 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:05.630177 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593cff2-9d1b-4772-b66b-2bd7a5c6c926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:05.651018 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-6593cff2-9d1b-4772-b66b-2bd7a5c6c926 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:46:05.652290 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-6593cff2-9d1b-4772-b66b-2bd7a5c6c926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:46:05.661681 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 532/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 09:46:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:46:06.018247 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f1686-f502-44d2-8e30-f41388ec087a None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:46:06.029949 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f1686-f502-44d2-8e30-f41388ec087a None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:46:06.033755 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fe96d-4bfc-49d0-a75c-c12927b005fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:46:06.034367 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fe96d-4bfc-49d0-a75c-c12927b005fc service neutron] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:06.034651 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fe96d-4bfc-49d0-a75c-c12927b005fc service neutron] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:06.035174 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fe96d-4bfc-49d0-a75c-c12927b005fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:06.044775 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fe96d-4bfc-49d0-a75c-c12927b005fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:46:06.046212 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fe96d-4bfc-49d0-a75c-c12927b005fc service neutron] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:46:06.055742 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 534/1066] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:46:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:46:08.674285 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778b51e-5c90-4134-a542-82cfb7a66007 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:08.674916 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778b51e-5c90-4134-a542-82cfb7a66007 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:08.674916 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778b51e-5c90-4134-a542-82cfb7a66007 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:08.676366 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 533/1067] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 09:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:46:08.682140 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343145e1-0101-47cb-b9e4-69f784b925fd None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:08.682614 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343145e1-0101-47cb-b9e4-69f784b925fd None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:08.682729 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343145e1-0101-47cb-b9e4-69f784b925fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:08.690559 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=60 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:46:08.704853 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-343145e1-0101-47cb-b9e4-69f784b925fd None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:46:08.706075 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-343145e1-0101-47cb-b9e4-69f784b925fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:46:08.714363 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 535/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 09:46:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:46:09.062043 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778b51e-5c90-4134-a542-82cfb7a66007 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:46:09.068418 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=55 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:46:09.075181 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778b51e-5c90-4134-a542-82cfb7a66007 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:46:09.078834 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35f96f-31df-4fe7-8c6c-1dd4fc0b5fb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:46:09.079446 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35f96f-31df-4fe7-8c6c-1dd4fc0b5fb4 service neutron] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:09.079721 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35f96f-31df-4fe7-8c6c-1dd4fc0b5fb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:09.079989 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35f96f-31df-4fe7-8c6c-1dd4fc0b5fb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:09.091163 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35f96f-31df-4fe7-8c6c-1dd4fc0b5fb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:46:09.092601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35f96f-31df-4fe7-8c6c-1dd4fc0b5fb4 service neutron] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:46:09.103024 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 534/1069] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:46:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:46:11.785831 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae3f9a-d40b-438d-b1df-48a2786e6396 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:11.786446 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae3f9a-d40b-438d-b1df-48a2786e6396 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:11.786446 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae3f9a-d40b-438d-b1df-48a2786e6396 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:11.787792 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 536/1070] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 09:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:46:11.794335 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abf873-66ad-45a2-8a1d-bdd49a24dd5c None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:11.795156 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abf873-66ad-45a2-8a1d-bdd49a24dd5c None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:11.795327 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abf873-66ad-45a2-8a1d-bdd49a24dd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:11.815721 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-63abf873-66ad-45a2-8a1d-bdd49a24dd5c None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:46:11.817582 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-63abf873-66ad-45a2-8a1d-bdd49a24dd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:46:11.825805 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 535/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 09:46:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:46:12.163233 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae3f9a-d40b-438d-b1df-48a2786e6396 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:46:12.176274 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae3f9a-d40b-438d-b1df-48a2786e6396 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:46:12.180563 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e14cee-5969-4e7f-91ae-775db178861a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:46:12.181209 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e14cee-5969-4e7f-91ae-775db178861a service neutron] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:12.181489 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e14cee-5969-4e7f-91ae-775db178861a service neutron] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:12.181761 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e14cee-5969-4e7f-91ae-775db178861a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:12.193412 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e14cee-5969-4e7f-91ae-775db178861a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:46:12.194949 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e14cee-5969-4e7f-91ae-775db178861a service neutron] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:46:12.206260 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 537/1072] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:46:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:46:14.779937 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3044f-1c31-4c27-bc8c-678054830e3f None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:14.780561 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3044f-1c31-4c27-bc8c-678054830e3f None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:14.780561 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3044f-1c31-4c27-bc8c-678054830e3f None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:14.781793 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 536/1073] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 09:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:46:14.787672 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc0ee5-6754-492e-8ce1-882abc914cc4 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:14.788133 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc0ee5-6754-492e-8ce1-882abc914cc4 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:14.788235 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc0ee5-6754-492e-8ce1-882abc914cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:14.808579 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-8fcc0ee5-6754-492e-8ce1-882abc914cc4 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:46:14.809783 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-8fcc0ee5-6754-492e-8ce1-882abc914cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:46:14.819523 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 538/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 09:46:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:46:15.156036 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3044f-1c31-4c27-bc8c-678054830e3f None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:46:15.168170 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3044f-1c31-4c27-bc8c-678054830e3f None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:46:15.171973 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da97c67-9ccd-4359-bd3e-5b7bb2c400a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:46:15.172575 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da97c67-9ccd-4359-bd3e-5b7bb2c400a2 service neutron] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:15.172846 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da97c67-9ccd-4359-bd3e-5b7bb2c400a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:15.173105 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da97c67-9ccd-4359-bd3e-5b7bb2c400a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:15.182849 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da97c67-9ccd-4359-bd3e-5b7bb2c400a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:46:15.184268 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da97c67-9ccd-4359-bd3e-5b7bb2c400a2 service neutron] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:46:15.194179 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 537/1075] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:46:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:46:17.658927 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ad7a4-db39-4418-bd17-1b578c5e224a None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:17.659744 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ad7a4-db39-4418-bd17-1b578c5e224a None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:17.659931 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ad7a4-db39-4418-bd17-1b578c5e224a None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:17.662942 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 539/1076] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 09:46:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:46:17.671841 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf71a2-0504-4b62-b15d-36a7f8163d52 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:17.672459 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf71a2-0504-4b62-b15d-36a7f8163d52 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:17.672459 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf71a2-0504-4b62-b15d-36a7f8163d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:17.695413 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-8fcf71a2-0504-4b62-b15d-36a7f8163d52 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:46:17.696828 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-8fcf71a2-0504-4b62-b15d-36a7f8163d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:46:17.705514 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 538/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 09:46:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:46:18.059610 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ad7a4-db39-4418-bd17-1b578c5e224a None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:46:18.071651 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ad7a4-db39-4418-bd17-1b578c5e224a None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:46:18.075520 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12983d2f-19ef-4598-b8b9-6ea02dde0877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:46:18.076134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12983d2f-19ef-4598-b8b9-6ea02dde0877 service neutron] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:18.076405 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12983d2f-19ef-4598-b8b9-6ea02dde0877 service neutron] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:18.076671 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12983d2f-19ef-4598-b8b9-6ea02dde0877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:18.087070 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12983d2f-19ef-4598-b8b9-6ea02dde0877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:46:18.088549 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12983d2f-19ef-4598-b8b9-6ea02dde0877 service neutron] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:46:18.099365 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 540/1078] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:46:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:46:20.669609 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3ce34-93b2-4db6-9646-968b334811f7 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:20.670323 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3ce34-93b2-4db6-9646-968b334811f7 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:20.670323 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3ce34-93b2-4db6-9646-968b334811f7 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:20.671558 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 539/1079] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 09:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:46:20.677496 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e1283-af79-446f-b9d4-3082177fef52 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:20.678064 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e1283-af79-446f-b9d4-3082177fef52 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:20.678064 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e1283-af79-446f-b9d4-3082177fef52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:20.698079 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-9e5e1283-af79-446f-b9d4-3082177fef52 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:46:20.699381 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-9e5e1283-af79-446f-b9d4-3082177fef52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:46:20.707890 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 541/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 09:46:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:46:21.045266 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3ce34-93b2-4db6-9646-968b334811f7 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:46:21.056976 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3ce34-93b2-4db6-9646-968b334811f7 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:46:21.060649 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96676540-d3c4-4fa2-94f1-fd1c323c0160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:46:21.061256 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96676540-d3c4-4fa2-94f1-fd1c323c0160 service neutron] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:21.061530 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96676540-d3c4-4fa2-94f1-fd1c323c0160 service neutron] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:21.061798 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96676540-d3c4-4fa2-94f1-fd1c323c0160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:21.071166 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96676540-d3c4-4fa2-94f1-fd1c323c0160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:46:21.072598 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96676540-d3c4-4fa2-94f1-fd1c323c0160 service neutron] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:46:21.082075 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 540/1081] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:46:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:46:23.561899 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec7f2d-212a-4665-ab29-a86169ad5f3a None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:23.562510 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec7f2d-212a-4665-ab29-a86169ad5f3a None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:23.562510 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec7f2d-212a-4665-ab29-a86169ad5f3a None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:23.563844 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 542/1082] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 09:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:46:23.570933 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b378c-c42a-4609-98c0-622d7be3de73 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:23.571630 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b378c-c42a-4609-98c0-622d7be3de73 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:23.571790 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b378c-c42a-4609-98c0-622d7be3de73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:23.597601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-fc5b378c-c42a-4609-98c0-622d7be3de73 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:46:23.598994 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-fc5b378c-c42a-4609-98c0-622d7be3de73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:46:23.608551 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 541/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 09:46:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:46:23.947692 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec7f2d-212a-4665-ab29-a86169ad5f3a None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:46:23.963105 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec7f2d-212a-4665-ab29-a86169ad5f3a None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:46:23.967257 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f24fad-5cab-4de6-bfa6-b425caf55737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:46:23.967882 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f24fad-5cab-4de6-bfa6-b425caf55737 service neutron] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:23.968152 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f24fad-5cab-4de6-bfa6-b425caf55737 service neutron] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:23.968421 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f24fad-5cab-4de6-bfa6-b425caf55737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:23.978377 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f24fad-5cab-4de6-bfa6-b425caf55737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:46:23.979883 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f24fad-5cab-4de6-bfa6-b425caf55737 service neutron] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:46:23.989651 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 543/1084] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:46:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:46:26.476376 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef345ff1-044c-4747-aa7b-9cab2b08d362 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:26.476975 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef345ff1-044c-4747-aa7b-9cab2b08d362 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:26.476975 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef345ff1-044c-4747-aa7b-9cab2b08d362 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:26.478266 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 542/1085] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 09:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:46:26.486406 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943076af-5af8-4962-a024-6d902e2f3fd0 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:26.486934 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943076af-5af8-4962-a024-6d902e2f3fd0 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:26.486934 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943076af-5af8-4962-a024-6d902e2f3fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:26.507010 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-943076af-5af8-4962-a024-6d902e2f3fd0 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:46:26.508196 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-943076af-5af8-4962-a024-6d902e2f3fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:46:26.516513 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 544/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 09:46:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:46:26.859289 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef345ff1-044c-4747-aa7b-9cab2b08d362 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:46:26.871618 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef345ff1-044c-4747-aa7b-9cab2b08d362 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:46:26.875792 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d6fca-0060-4efe-9fbb-d0447067d890 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:46:26.876394 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d6fca-0060-4efe-9fbb-d0447067d890 service neutron] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:26.876666 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d6fca-0060-4efe-9fbb-d0447067d890 service neutron] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:26.876928 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d6fca-0060-4efe-9fbb-d0447067d890 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:26.886596 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d6fca-0060-4efe-9fbb-d0447067d890 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:46:26.888068 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d6fca-0060-4efe-9fbb-d0447067d890 service neutron] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:46:26.897867 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 543/1087] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:46:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:46:36.501709 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=29 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:46:36.893405 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=32 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:46:53.050002 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17833d25-aad0-4b47-a2c1-0c6fbeda9f48 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:53.050953 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17833d25-aad0-4b47-a2c1-0c6fbeda9f48 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:53.050953 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17833d25-aad0-4b47-a2c1-0c6fbeda9f48 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:53.052374 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 545/1088] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:46:53.058383 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3943e-00b8-4c8b-9249-647494e6606a None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:53.058949 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3943e-00b8-4c8b-9249-647494e6606a None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:53.059054 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3943e-00b8-4c8b-9249-647494e6606a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:53.080550 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-33b3943e-00b8-4c8b-9249-647494e6606a None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:46:53.081903 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-33b3943e-00b8-4c8b-9249-647494e6606a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:46:53.090608 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 544/1089] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:46:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:46:53.461348 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5a80c-b0c6-4d93-b4ea-1ba1123e252f None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:53.461624 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5a80c-b0c6-4d93-b4ea-1ba1123e252f None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:53.461904 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5a80c-b0c6-4d93-b4ea-1ba1123e252f None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:53.463314 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 546/1090] 10.222.0.49 () {54 vars in 962 bytes} [Tue Sep 27 09:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:46:53.470375 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7746139-aa7f-4617-bb41-71c8eac434b4 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:53.470641 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7746139-aa7f-4617-bb41-71c8eac434b4 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:53.470932 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7746139-aa7f-4617-bb41-71c8eac434b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:53.493366 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-c7746139-aa7f-4617-bb41-71c8eac434b4 None None] MFA Rules not processed for user `1575d436c7d043d886293e24fa5f64fb`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:46:53.494615 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-c7746139-aa7f-4617-bb41-71c8eac434b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:46:53.503071 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 545/1091] 10.222.0.49 () {58 vars in 1059 bytes} [Tue Sep 27 09:46:53 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 09:46:53.515721 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5a80c-b0c6-4d93-b4ea-1ba1123e252f None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:46:53.534266 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5a80c-b0c6-4d93-b4ea-1ba1123e252f None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:46:53.540294 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36edb8c5-86cb-4147-badb-7f86d5f7e834 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1575d436c7d043d886293e24fa5f64fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:46:53.541018 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edb8c5-86cb-4147-badb-7f86d5f7e834 service glance] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:53.541384 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edb8c5-86cb-4147-badb-7f86d5f7e834 service glance] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:53.541657 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edb8c5-86cb-4147-badb-7f86d5f7e834 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:53.556026 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36edb8c5-86cb-4147-badb-7f86d5f7e834 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:46:53.558083 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36edb8c5-86cb-4147-badb-7f86d5f7e834 service glance] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:46:53.570544 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 547/1092] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:46:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:46:56.173294 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63073899-a4e9-427c-a0b0-dddd0ad3cb04 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:56.173906 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63073899-a4e9-427c-a0b0-dddd0ad3cb04 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:56.174008 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63073899-a4e9-427c-a0b0-dddd0ad3cb04 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:56.175471 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 546/1093] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:46:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:46:56.182991 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f003ea3-365e-4fe1-ac36-04356410fda5 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:56.183514 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f003ea3-365e-4fe1-ac36-04356410fda5 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:56.184237 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f003ea3-365e-4fe1-ac36-04356410fda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:56.204614 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-9f003ea3-365e-4fe1-ac36-04356410fda5 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:46:56.205801 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-9f003ea3-365e-4fe1-ac36-04356410fda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:46:56.214225 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 548/1094] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:46:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:46:56.536667 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63073899-a4e9-427c-a0b0-dddd0ad3cb04 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:46:56.549929 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63073899-a4e9-427c-a0b0-dddd0ad3cb04 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:46:56.555463 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00cd00-d321-4aea-9ee8-bb298597192c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:46:56.556114 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00cd00-d321-4aea-9ee8-bb298597192c admin admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:56.556392 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00cd00-d321-4aea-9ee8-bb298597192c admin admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:56.556663 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00cd00-d321-4aea-9ee8-bb298597192c admin admin] PATH_INFO: `/v3/projects` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:56.557308 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00cd00-d321-4aea-9ee8-bb298597192c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:46:56.559153 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: WARNING py.warnings [None req-ea00cd00-d321-4aea-9ee8-bb298597192c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 09:46:56.559153 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: warnings.warn(msg) Sep 27 09:46:56.559153 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: Sep 27 09:46:56.560320 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00cd00-d321-4aea-9ee8-bb298597192c admin admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:46:56.579768 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 547/1095] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Sep 27 09:46:56 2022] GET /identity/v3/projects => generated 1606 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 09:46:59.159476 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1df54-e4e1-46c4-a8e5-102ff958410c None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:59.160088 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1df54-e4e1-46c4-a8e5-102ff958410c None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:59.160088 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1df54-e4e1-46c4-a8e5-102ff958410c None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:59.161516 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 549/1096] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:46:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:46:59.169347 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839e626-ff43-44ad-a9c0-47eca959eeb1 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:59.169985 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839e626-ff43-44ad-a9c0-47eca959eeb1 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:59.169985 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839e626-ff43-44ad-a9c0-47eca959eeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:59.192017 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-f839e626-ff43-44ad-a9c0-47eca959eeb1 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:46:59.193625 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-f839e626-ff43-44ad-a9c0-47eca959eeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:46:59.202197 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 548/1097] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:46:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:46:59.593729 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1df54-e4e1-46c4-a8e5-102ff958410c None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:46:59.615159 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1df54-e4e1-46c4-a8e5-102ff958410c None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:46:59.622283 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e9a54-3091-4663-a33b-47afa643cbb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:46:59.623332 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e9a54-3091-4663-a33b-47afa643cbb1 service nova] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:46:59.623804 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e9a54-3091-4663-a33b-47afa643cbb1 service nova] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:46:59.624268 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e9a54-3091-4663-a33b-47afa643cbb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:46:59.635611 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e9a54-3091-4663-a33b-47afa643cbb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:46:59.637287 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e9a54-3091-4663-a33b-47afa643cbb1 service nova] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:46:59.648876 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 550/1098] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:46:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 09:47:02.399993 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f07ab-a473-4b00-8663-41ce4bfdbc88 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:47:02.400612 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f07ab-a473-4b00-8663-41ce4bfdbc88 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:47:02.400612 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f07ab-a473-4b00-8663-41ce4bfdbc88 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:47:02.402716 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 549/1099] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:47:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:47:02.409365 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33493a4-c270-48b9-b021-5d4656ed5a2a None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:47:02.409984 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33493a4-c270-48b9-b021-5d4656ed5a2a None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:47:02.410115 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33493a4-c270-48b9-b021-5d4656ed5a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:47:02.431460 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-b33493a4-c270-48b9-b021-5d4656ed5a2a None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:47:02.432677 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-b33493a4-c270-48b9-b021-5d4656ed5a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:47:02.440588 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 551/1100] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:47:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:47:02.786737 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f07ab-a473-4b00-8663-41ce4bfdbc88 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:47:02.798850 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f07ab-a473-4b00-8663-41ce4bfdbc88 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:47:02.804651 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e0701-dcf4-429d-8833-3f8bcd7347bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:47:02.805652 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e0701-dcf4-429d-8833-3f8bcd7347bb service neutron] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:47:02.806096 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e0701-dcf4-429d-8833-3f8bcd7347bb service neutron] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:47:02.806559 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e0701-dcf4-429d-8833-3f8bcd7347bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:47:02.821942 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e0701-dcf4-429d-8833-3f8bcd7347bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:47:02.823490 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e0701-dcf4-429d-8833-3f8bcd7347bb service neutron] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:47:02.835148 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 550/1101] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:47:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:47:05.431619 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc1106-a423-4c48-ae8e-31dc9c01d683 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:47:05.432358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc1106-a423-4c48-ae8e-31dc9c01d683 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:47:05.432358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc1106-a423-4c48-ae8e-31dc9c01d683 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:47:05.433497 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 552/1102] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:47:05.439616 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc13dcc-770c-4b74-9996-cf7f96ac14bd None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:47:05.440258 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc13dcc-770c-4b74-9996-cf7f96ac14bd None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:47:05.440426 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc13dcc-770c-4b74-9996-cf7f96ac14bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:47:05.466373 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-2fc13dcc-770c-4b74-9996-cf7f96ac14bd None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:47:05.468019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-2fc13dcc-770c-4b74-9996-cf7f96ac14bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:47:05.478781 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 551/1103] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:47:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:47:05.838299 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc1106-a423-4c48-ae8e-31dc9c01d683 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:47:05.849874 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc1106-a423-4c48-ae8e-31dc9c01d683 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:47:05.853740 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55685a54-9e99-440d-b753-60c9dd5f29d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:47:05.854362 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55685a54-9e99-440d-b753-60c9dd5f29d5 service neutron] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:47:05.854634 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55685a54-9e99-440d-b753-60c9dd5f29d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:47:05.854941 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55685a54-9e99-440d-b753-60c9dd5f29d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:47:05.865056 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55685a54-9e99-440d-b753-60c9dd5f29d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:47:05.866518 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55685a54-9e99-440d-b753-60c9dd5f29d5 service neutron] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:47:05.877009 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 553/1104] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:47:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:47:08.843428 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c1f61-4ba5-4299-a243-080f855f51c9 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:47:08.843988 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c1f61-4ba5-4299-a243-080f855f51c9 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:47:08.843988 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c1f61-4ba5-4299-a243-080f855f51c9 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:47:08.845227 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 552/1105] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:47:08.851384 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a78f1-28fc-4f4b-9d13-9bad71af8eb4 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:47:08.851918 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a78f1-28fc-4f4b-9d13-9bad71af8eb4 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:47:08.851918 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a78f1-28fc-4f4b-9d13-9bad71af8eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:47:08.873001 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-e66a78f1-28fc-4f4b-9d13-9bad71af8eb4 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:47:08.874225 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-e66a78f1-28fc-4f4b-9d13-9bad71af8eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:47:08.883547 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 554/1106] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:47:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:47:09.243684 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c1f61-4ba5-4299-a243-080f855f51c9 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:47:09.255930 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c1f61-4ba5-4299-a243-080f855f51c9 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:47:09.259890 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a116b1-5f24-484b-93d1-e50d88f0cc69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:47:09.260504 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a116b1-5f24-484b-93d1-e50d88f0cc69 service neutron] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:47:09.260782 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a116b1-5f24-484b-93d1-e50d88f0cc69 service neutron] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:47:09.261058 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a116b1-5f24-484b-93d1-e50d88f0cc69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:47:09.271439 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a116b1-5f24-484b-93d1-e50d88f0cc69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:47:09.272915 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a116b1-5f24-484b-93d1-e50d88f0cc69 service neutron] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:47:09.282670 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 553/1107] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:47:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:47:11.956618 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf232cb-b52b-4441-8a74-d1643a2f56cc None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:47:11.957204 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf232cb-b52b-4441-8a74-d1643a2f56cc None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:47:11.957489 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf232cb-b52b-4441-8a74-d1643a2f56cc None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:47:11.960648 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 555/1108] 10.222.0.49 () {54 vars in 927 bytes} [Tue Sep 27 09:47:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:47:11.968984 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a611b8-e266-4640-9cc9-74ce1a22655e None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:47:11.969749 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a611b8-e266-4640-9cc9-74ce1a22655e None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:47:11.969900 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a611b8-e266-4640-9cc9-74ce1a22655e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:47:11.993219 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-06a611b8-e266-4640-9cc9-74ce1a22655e None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:47:11.994447 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-06a611b8-e266-4640-9cc9-74ce1a22655e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:47:12.010267 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 554/1109] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Sep 27 09:47:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:47:12.361098 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf232cb-b52b-4441-8a74-d1643a2f56cc None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:47:12.372911 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf232cb-b52b-4441-8a74-d1643a2f56cc None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:47:12.376609 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828a0e4-dfc2-4c5b-a6a0-37ddde44f999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:47:12.377255 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828a0e4-dfc2-4c5b-a6a0-37ddde44f999 service neutron] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:47:12.377603 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828a0e4-dfc2-4c5b-a6a0-37ddde44f999 service neutron] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:47:12.377888 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828a0e4-dfc2-4c5b-a6a0-37ddde44f999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:47:12.389157 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828a0e4-dfc2-4c5b-a6a0-37ddde44f999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:47:12.390955 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828a0e4-dfc2-4c5b-a6a0-37ddde44f999 service neutron] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:47:12.403626 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 556/1110] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:47:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 09:47:21.987138 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=33 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:47:22.398902 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=33 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:48:36.894495 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe9e4e-d390-4454-9299-c07c297bcfda None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:48:36.895206 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe9e4e-d390-4454-9299-c07c297bcfda None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:48:36.895206 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe9e4e-d390-4454-9299-c07c297bcfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:48:36.976452 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-8bfe9e4e-d390-4454-9299-c07c297bcfda None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:48:36.978577 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-8bfe9e4e-d390-4454-9299-c07c297bcfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:48:37.043941 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 555/1111] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 27 09:48:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:48:37.053414 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494d7d1-289d-4135-8e9c-d3a27219a8a2 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:48:37.054086 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494d7d1-289d-4135-8e9c-d3a27219a8a2 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:48:37.054195 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494d7d1-289d-4135-8e9c-d3a27219a8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:48:37.083341 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-a494d7d1-289d-4135-8e9c-d3a27219a8a2 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:48:37.084585 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-a494d7d1-289d-4135-8e9c-d3a27219a8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:48:37.093659 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 557/1112] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 27 09:48:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:48:37.098738 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe9e4e-d390-4454-9299-c07c297bcfda None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:48:37.112250 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe9e4e-d390-4454-9299-c07c297bcfda None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:48:37.118529 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90974ef-a2fe-43ae-82ef-89efdbbba12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:48:37.119197 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90974ef-a2fe-43ae-82ef-89efdbbba12f admin admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:48:37.119476 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90974ef-a2fe-43ae-82ef-89efdbbba12f admin admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:48:37.119746 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90974ef-a2fe-43ae-82ef-89efdbbba12f admin admin] PATH_INFO: `/v3/domains` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:48:37.120397 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90974ef-a2fe-43ae-82ef-89efdbbba12f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:48:37.120699 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90974ef-a2fe-43ae-82ef-89efdbbba12f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:48:37.121724 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: WARNING py.warnings [None req-b90974ef-a2fe-43ae-82ef-89efdbbba12f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 27 09:48:37.121724 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: warnings.warn(msg) Sep 27 09:48:37.121724 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: Sep 27 09:48:37.122681 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90974ef-a2fe-43ae-82ef-89efdbbba12f admin admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:48:37.137352 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 556/1113] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 27 09:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:48:37.146227 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494d7d1-289d-4135-8e9c-d3a27219a8a2 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:48:37.156545 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494d7d1-289d-4135-8e9c-d3a27219a8a2 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:48:37.161665 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86f553-ecfb-4c27-9639-6b9cb24d1fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:48:37.162294 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86f553-ecfb-4c27-9639-6b9cb24d1fec admin admin] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:48:37.162573 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86f553-ecfb-4c27-9639-6b9cb24d1fec admin admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:48:37.162875 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86f553-ecfb-4c27-9639-6b9cb24d1fec admin admin] PATH_INFO: `/v3/projects` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:48:37.163516 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb86f553-ecfb-4c27-9639-6b9cb24d1fec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:48:37.165360 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: WARNING py.warnings [None req-fb86f553-ecfb-4c27-9639-6b9cb24d1fec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 09:48:37.165360 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: warnings.warn(msg) Sep 27 09:48:37.165360 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: Sep 27 09:48:37.166592 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb86f553-ecfb-4c27-9639-6b9cb24d1fec admin admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:48:37.209977 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 558/1114] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 27 09:48:37 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:48:37.214809 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90974ef-a2fe-43ae-82ef-89efdbbba12f admin admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:48:37.230240 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90974ef-a2fe-43ae-82ef-89efdbbba12f admin admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:48:37.304950 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c6583-8466-4c98-9d7a-f623177922e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:48:37.305589 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c6583-8466-4c98-9d7a-f623177922e3 admin admin] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:48:37.305860 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c6583-8466-4c98-9d7a-f623177922e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:48:37.306121 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c6583-8466-4c98-9d7a-f623177922e3 admin admin] PATH_INFO: `/v3/users` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:48:37.306758 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c6583-8466-4c98-9d7a-f623177922e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:48:37.307810 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: WARNING py.warnings [None req-e17c6583-8466-4c98-9d7a-f623177922e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 09:48:37.307810 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: warnings.warn(msg) Sep 27 09:48:37.307810 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: Sep 27 09:48:37.309015 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c6583-8466-4c98-9d7a-f623177922e3 admin admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:48:37.333145 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 557/1115] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 27 09:48:37 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:48:37.337451 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86f553-ecfb-4c27-9639-6b9cb24d1fec admin admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:48:37.348664 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86f553-ecfb-4c27-9639-6b9cb24d1fec admin admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:48:37.354288 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d8a2e-8546-47bc-a3bd-ce2229b2713e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:48:37.354939 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d8a2e-8546-47bc-a3bd-ce2229b2713e admin admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:48:37.355219 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d8a2e-8546-47bc-a3bd-ce2229b2713e admin admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:48:37.355489 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d8a2e-8546-47bc-a3bd-ce2229b2713e admin admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:48:37.356137 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d8a2e-8546-47bc-a3bd-ce2229b2713e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:48:37.357174 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: WARNING py.warnings [None req-c02d8a2e-8546-47bc-a3bd-ce2229b2713e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 27 09:48:37.357174 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: warnings.warn(msg) Sep 27 09:48:37.357174 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: Sep 27 09:48:37.358062 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d8a2e-8546-47bc-a3bd-ce2229b2713e admin admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:48:37.371865 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 559/1116] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 27 09:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 09:48:37.376147 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c6583-8466-4c98-9d7a-f623177922e3 admin admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:48:37.386701 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c6583-8466-4c98-9d7a-f623177922e3 admin admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:48:37.391634 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92d891-12a8-4508-9d02-1925583ededc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:48:37.392271 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92d891-12a8-4508-9d02-1925583ededc admin admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:48:37.392548 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92d891-12a8-4508-9d02-1925583ededc admin admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:48:37.392814 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92d891-12a8-4508-9d02-1925583ededc admin admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:48:37.393487 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92d891-12a8-4508-9d02-1925583ededc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:48:37.394479 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: WARNING py.warnings [None req-2c92d891-12a8-4508-9d02-1925583ededc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 27 09:48:37.394479 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: warnings.warn(msg) Sep 27 09:48:37.394479 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: Sep 27 09:48:37.395409 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92d891-12a8-4508-9d02-1925583ededc admin admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:48:37.409580 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 558/1117] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 27 09:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 09:48:37.413848 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d8a2e-8546-47bc-a3bd-ce2229b2713e admin admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:48:37.424743 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d8a2e-8546-47bc-a3bd-ce2229b2713e admin admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:48:37.431052 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9fba1-1fcd-449e-842a-a191688ec3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:48:37.431725 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9fba1-1fcd-449e-842a-a191688ec3a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:48:37.431994 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9fba1-1fcd-449e-842a-a191688ec3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:48:37.432243 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9fba1-1fcd-449e-842a-a191688ec3a2 admin admin] PATH_INFO: `/v3/projects/408f653e9ff24e4985f3d68a86ce21c9/users/d83a1e3989734c0cbf8b79fe2fe7560a/roles/378cb7fb6a4e4e5e89ab9a0ecb09d86b` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:48:37.448817 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9fba1-1fcd-449e-842a-a191688ec3a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=408f653e9ff24e4985f3d68a86ce21c9, user_id=d83a1e3989734c0cbf8b79fe2fe7560a, role_id=378cb7fb6a4e4e5e89ab9a0ecb09d86b)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:48:37.449879 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: WARNING py.warnings [None req-31a9fba1-1fcd-449e-842a-a191688ec3a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 09:48:37.449879 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: warnings.warn(msg) Sep 27 09:48:37.449879 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: Sep 27 09:48:37.451925 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9fba1-1fcd-449e-842a-a191688ec3a2 admin admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:48:37.466148 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 560/1118] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 27 09:48:37 2022] PUT /identity/v3/projects/408f653e9ff24e4985f3d68a86ce21c9/users/d83a1e3989734c0cbf8b79fe2fe7560a/roles/378cb7fb6a4e4e5e89ab9a0ecb09d86b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 09:48:37.479153 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998394d-6e09-426c-89fa-50a001f15c5e None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:48:37.479439 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998394d-6e09-426c-89fa-50a001f15c5e None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:48:37.479711 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998394d-6e09-426c-89fa-50a001f15c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:48:37.510435 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-d998394d-6e09-426c-89fa-50a001f15c5e None None] MFA Rules not processed for user `d83a1e3989734c0cbf8b79fe2fe7560a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:48:37.511684 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-d998394d-6e09-426c-89fa-50a001f15c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:48:37.547767 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:48:37.585456 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 559/1119] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 27 09:48:37 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:48:37.599692 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77feeefd-43a0-4b39-8880-fd34f057ebce None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:48:37.599977 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77feeefd-43a0-4b39-8880-fd34f057ebce None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:48:37.600249 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77feeefd-43a0-4b39-8880-fd34f057ebce None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:48:37.601603 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 561/1120] 10.222.0.49 () {54 vars in 963 bytes} [Tue Sep 27 09:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:48:37.608317 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ffc26-db88-40a4-8f24-88b61a46497b None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:48:37.608606 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ffc26-db88-40a4-8f24-88b61a46497b None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:48:37.608881 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ffc26-db88-40a4-8f24-88b61a46497b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:48:37.640863 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-ae5ffc26-db88-40a4-8f24-88b61a46497b None None] MFA Rules not processed for user `25ffb8d1c3014daab3b00e2a059af76b`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:48:37.642078 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-ae5ffc26-db88-40a4-8f24-88b61a46497b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:48:37.715358 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 560/1121] 10.222.0.49 () {58 vars in 1060 bytes} [Tue Sep 27 09:48:37 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:48:37.723927 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77feeefd-43a0-4b39-8880-fd34f057ebce None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:48:37.735233 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77feeefd-43a0-4b39-8880-fd34f057ebce None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:48:37.739197 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4f0a8-53a0-46d4-9437-75e6e63b2cf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25ffb8d1c3014daab3b00e2a059af76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:48:37.739807 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4f0a8-53a0-46d4-9437-75e6e63b2cf2 service cinder] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:48:37.740089 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4f0a8-53a0-46d4-9437-75e6e63b2cf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:48:37.740355 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4f0a8-53a0-46d4-9437-75e6e63b2cf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:48:37.749309 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4f0a8-53a0-46d4-9437-75e6e63b2cf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:48:37.750752 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4f0a8-53a0-46d4-9437-75e6e63b2cf2 service cinder] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:48:37.760087 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 562/1122] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:48:37 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:48:37.800911 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418540a3-91c3-4077-b037-8702479b8cc5 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:48:37.801191 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418540a3-91c3-4077-b037-8702479b8cc5 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:48:37.801458 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418540a3-91c3-4077-b037-8702479b8cc5 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:48:37.802739 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 561/1123] 10.222.0.49 () {52 vars in 830 bytes} [Tue Sep 27 09:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:48:37.806690 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4f0a8-53a0-46d4-9437-75e6e63b2cf2 service cinder] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:48:37.878534 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4f0a8-53a0-46d4-9437-75e6e63b2cf2 service cinder] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:48:37.884081 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844112f8-7960-4a1b-8521-2c5d5508a8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:48:37.884715 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844112f8-7960-4a1b-8521-2c5d5508a8d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:48:37.884987 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844112f8-7960-4a1b-8521-2c5d5508a8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:48:37.885258 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844112f8-7960-4a1b-8521-2c5d5508a8d0 admin admin] PATH_INFO: `/v3/users/d83a1e3989734c0cbf8b79fe2fe7560a` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:48:37.886505 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844112f8-7960-4a1b-8521-2c5d5508a8d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d83a1e3989734c0cbf8b79fe2fe7560a)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:48:37.887567 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: WARNING py.warnings [None req-844112f8-7960-4a1b-8521-2c5d5508a8d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 09:48:37.887567 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: warnings.warn(msg) Sep 27 09:48:37.887567 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: Sep 27 09:48:37.888760 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844112f8-7960-4a1b-8521-2c5d5508a8d0 admin admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:48:37.960972 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [None req-844112f8-7960-4a1b-8521-2c5d5508a8d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd83a1e3989734c0cbf8b79fe2fe7560a'} {{(pid=99838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 09:48:37.961659 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [None req-844112f8-7960-4a1b-8521-2c5d5508a8d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd83a1e3989734c0cbf8b79fe2fe7560a'} {{(pid=99838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 09:48:37.962412 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [None req-844112f8-7960-4a1b-8521-2c5d5508a8d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd83a1e3989734c0cbf8b79fe2fe7560a'} {{(pid=99838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 09:48:37.977284 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [None req-844112f8-7960-4a1b-8521-2c5d5508a8d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd83a1e3989734c0cbf8b79fe2fe7560a'} {{(pid=99838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 09:48:37.989386 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [None req-844112f8-7960-4a1b-8521-2c5d5508a8d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd83a1e3989734c0cbf8b79fe2fe7560a'} {{(pid=99838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 09:48:38.010802 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:48:38.019781 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 563/1124] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 27 09:48:37 2022] DELETE /identity/v3/users/d83a1e3989734c0cbf8b79fe2fe7560a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 09:48:38.024389 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfe1f8-e5c7-409c-ae83-17ae8a842654 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:48:38.024897 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfe1f8-e5c7-409c-ae83-17ae8a842654 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:48:38.025007 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfe1f8-e5c7-409c-ae83-17ae8a842654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:48:38.045194 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-30dfe1f8-e5c7-409c-ae83-17ae8a842654 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:48:38.046390 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-30dfe1f8-e5c7-409c-ae83-17ae8a842654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:48:38.106166 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 562/1125] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 27 09:48:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:48:38.116599 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844112f8-7960-4a1b-8521-2c5d5508a8d0 admin admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:48:38.119075 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-844112f8-7960-4a1b-8521-2c5d5508a8d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:48:38.185530 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844112f8-7960-4a1b-8521-2c5d5508a8d0 admin admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:48:38.189731 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6d456-b855-477f-bd6b-91cc5cdc7be5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:48:38.190449 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6d456-b855-477f-bd6b-91cc5cdc7be5 service neutron] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:48:38.190734 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6d456-b855-477f-bd6b-91cc5cdc7be5 service neutron] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:48:38.191048 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6d456-b855-477f-bd6b-91cc5cdc7be5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:48:38.201188 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6d456-b855-477f-bd6b-91cc5cdc7be5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:48:38.202648 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6d456-b855-477f-bd6b-91cc5cdc7be5 service neutron] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:48:38.213499 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 564/1126] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:48:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:48:38.577616 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfe1f8-e5c7-409c-ae83-17ae8a842654 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:48:38.579064 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-30dfe1f8-e5c7-409c-ae83-17ae8a842654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:48:38.592593 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfe1f8-e5c7-409c-ae83-17ae8a842654 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:48:38.598958 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62dc90e-2515-4a24-bad1-e4b630e0a274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:48:38.600052 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dc90e-2515-4a24-bad1-e4b630e0a274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:48:38.600324 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dc90e-2515-4a24-bad1-e4b630e0a274 admin admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:48:38.600590 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dc90e-2515-4a24-bad1-e4b630e0a274 admin admin] PATH_INFO: `/v3/projects/408f653e9ff24e4985f3d68a86ce21c9` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:48:38.601826 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62dc90e-2515-4a24-bad1-e4b630e0a274 admin admin] RBAC: Authorizing `identity:delete_project(project_id=408f653e9ff24e4985f3d68a86ce21c9)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:48:38.602864 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: WARNING py.warnings [None req-b62dc90e-2515-4a24-bad1-e4b630e0a274 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 09:48:38.602864 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: warnings.warn(msg) Sep 27 09:48:38.602864 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: Sep 27 09:48:38.605819 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62dc90e-2515-4a24-bad1-e4b630e0a274 admin admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:48:38.673272 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [None req-b62dc90e-2515-4a24-bad1-e4b630e0a274 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '408f653e9ff24e4985f3d68a86ce21c9', 'request_id': 'req-b62dc90e-2515-4a24-bad1-e4b630e0a274'} {{(pid=99839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 09:48:38.677833 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:48:38.680471 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [None req-b62dc90e-2515-4a24-bad1-e4b630e0a274 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '408f653e9ff24e4985f3d68a86ce21c9', 'request_id': 'req-b62dc90e-2515-4a24-bad1-e4b630e0a274'} {{(pid=99839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 09:48:38.695694 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [None req-b62dc90e-2515-4a24-bad1-e4b630e0a274 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '408f653e9ff24e4985f3d68a86ce21c9', 'request_id': 'req-b62dc90e-2515-4a24-bad1-e4b630e0a274'} {{(pid=99839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 09:48:38.713898 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [None req-b62dc90e-2515-4a24-bad1-e4b630e0a274 admin admin] The token cache is being invalidate because project 408f653e9ff24e4985f3d68a86ce21c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 09:48:38.714187 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [None req-b62dc90e-2515-4a24-bad1-e4b630e0a274 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 09:48:38.715004 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [None req-b62dc90e-2515-4a24-bad1-e4b630e0a274 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 09:48:38.716594 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 563/1127] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 27 09:48:38 2022] DELETE /identity/v3/projects/408f653e9ff24e4985f3d68a86ce21c9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 09:48:48.208811 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:48:48.710027 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:DELETE=2,keystone:SELECT=5,keystone:INSERT=1 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:50:00.474231 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae716f3d-6683-42e4-bdb8-8f3cbbf6a547 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:50:00.474982 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae716f3d-6683-42e4-bdb8-8f3cbbf6a547 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:50:00.474982 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae716f3d-6683-42e4-bdb8-8f3cbbf6a547 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:50:00.476338 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 565/1128] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 09:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:50:00.481805 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bb7ac-4408-461c-887f-a25f5f381c0e None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:50:00.482282 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bb7ac-4408-461c-887f-a25f5f381c0e None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:50:00.482419 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bb7ac-4408-461c-887f-a25f5f381c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:50:00.504285 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-9b0bb7ac-4408-461c-887f-a25f5f381c0e None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:50:00.505527 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-9b0bb7ac-4408-461c-887f-a25f5f381c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:50:00.572088 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 564/1129] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 09:50:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:50:00.734723 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae716f3d-6683-42e4-bdb8-8f3cbbf6a547 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:50:00.736627 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-ae716f3d-6683-42e4-bdb8-8f3cbbf6a547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:50:00.834077 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae716f3d-6683-42e4-bdb8-8f3cbbf6a547 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:50:00.840279 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934b302-59a8-48f6-818e-a7da9653cde6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:50:00.840435 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934b302-59a8-48f6-818e-a7da9653cde6 service nova] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:50:00.840712 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934b302-59a8-48f6-818e-a7da9653cde6 service nova] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:50:00.840981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934b302-59a8-48f6-818e-a7da9653cde6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:50:00.849873 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934b302-59a8-48f6-818e-a7da9653cde6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:50:00.851606 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934b302-59a8-48f6-818e-a7da9653cde6 service nova] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:50:00.861426 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 566/1130] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:50:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:50:02.527029 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4d352-1264-453b-b6f1-ad6d87a8ab54 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:50:02.527631 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4d352-1264-453b-b6f1-ad6d87a8ab54 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:50:02.527631 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4d352-1264-453b-b6f1-ad6d87a8ab54 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:50:02.529237 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 565/1131] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 09:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:50:02.535482 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a476f4-045c-40b0-9a0d-e849b2e3dc95 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:50:02.536089 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a476f4-045c-40b0-9a0d-e849b2e3dc95 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:50:02.536089 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a476f4-045c-40b0-9a0d-e849b2e3dc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:50:02.562486 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-e3a476f4-045c-40b0-9a0d-e849b2e3dc95 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:50:02.563728 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-e3a476f4-045c-40b0-9a0d-e849b2e3dc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:50:02.573778 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 567/1132] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 09:50:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 09:50:02.758261 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4d352-1264-453b-b6f1-ad6d87a8ab54 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:50:02.776527 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4d352-1264-453b-b6f1-ad6d87a8ab54 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:50:02.785047 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3408f18-632b-42b8-8bf9-70c32f169c5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:50:02.785497 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3408f18-632b-42b8-8bf9-70c32f169c5b service nova] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:50:02.785837 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3408f18-632b-42b8-8bf9-70c32f169c5b service nova] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:50:02.786128 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3408f18-632b-42b8-8bf9-70c32f169c5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:50:02.796801 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3408f18-632b-42b8-8bf9-70c32f169c5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:50:02.798432 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3408f18-632b-42b8-8bf9-70c32f169c5b service nova] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:50:02.809973 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 566/1133] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:50:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:50:05.986790 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129a683-38fb-453e-97ad-3310d7edc97d None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:50:05.987433 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129a683-38fb-453e-97ad-3310d7edc97d None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:50:05.987433 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129a683-38fb-453e-97ad-3310d7edc97d None None] PATH_INFO: `/v3` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:50:05.988670 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 568/1134] 10.222.0.62 () {54 vars in 925 bytes} [Tue Sep 27 09:50:05 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:50:05.996076 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccc629-3e35-4845-ae47-db193a42aaee None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:50:05.996626 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccc629-3e35-4845-ae47-db193a42aaee None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:50:05.996626 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccc629-3e35-4845-ae47-db193a42aaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:50:06.021432 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-1fccc629-3e35-4845-ae47-db193a42aaee None None] MFA Rules not processed for user `8d7d537583c64b5cabe287be6875a478`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:50:06.022669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-1fccc629-3e35-4845-ae47-db193a42aaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:50:06.096492 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 567/1135] 10.222.0.62 () {58 vars in 1015 bytes} [Tue Sep 27 09:50:05 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:50:12.553517 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=40 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:50:14.695247 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5c0b4-2e08-47cf-8eb2-58d7815fb72d None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:50:14.695247 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5c0b4-2e08-47cf-8eb2-58d7815fb72d None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:50:14.696826 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5c0b4-2e08-47cf-8eb2-58d7815fb72d None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:50:14.697416 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 569/1136] 10.222.0.49 () {54 vars in 961 bytes} [Tue Sep 27 09:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:50:14.703586 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b47b9c-f4f4-4370-8ecf-dc7742421fc8 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:50:14.704074 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b47b9c-f4f4-4370-8ecf-dc7742421fc8 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:50:14.704202 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b47b9c-f4f4-4370-8ecf-dc7742421fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:50:14.725553 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-62b47b9c-f4f4-4370-8ecf-dc7742421fc8 None None] MFA Rules not processed for user `8d7d537583c64b5cabe287be6875a478`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:50:14.726802 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-62b47b9c-f4f4-4370-8ecf-dc7742421fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:50:14.735976 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 568/1137] 10.222.0.49 () {58 vars in 1058 bytes} [Tue Sep 27 09:50:14 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:50:14.743644 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5c0b4-2e08-47cf-8eb2-58d7815fb72d None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:50:14.758464 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5c0b4-2e08-47cf-8eb2-58d7815fb72d None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:50:14.763845 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca85635-6dd7-4cf6-bf8f-1cafb428e5e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d7d537583c64b5cabe287be6875a478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:50:14.764444 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca85635-6dd7-4cf6-bf8f-1cafb428e5e1 service placement] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:50:14.764712 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca85635-6dd7-4cf6-bf8f-1cafb428e5e1 service placement] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:50:14.764970 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca85635-6dd7-4cf6-bf8f-1cafb428e5e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:50:14.774638 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca85635-6dd7-4cf6-bf8f-1cafb428e5e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:50:14.776273 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca85635-6dd7-4cf6-bf8f-1cafb428e5e1 service placement] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:50:14.786330 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 570/1138] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:50:14 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:50:14.929487 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53259c9e-2dc8-470f-8ead-e4a631f3baa7 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:50:14.929746 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53259c9e-2dc8-470f-8ead-e4a631f3baa7 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:50:14.930023 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53259c9e-2dc8-470f-8ead-e4a631f3baa7 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:50:14.931422 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 569/1139] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 09:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:50:14.936432 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae90a39-52cc-49dc-b909-4794dae9c3ef None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:50:14.936717 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae90a39-52cc-49dc-b909-4794dae9c3ef None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:50:14.936990 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae90a39-52cc-49dc-b909-4794dae9c3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:50:14.957042 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-5ae90a39-52cc-49dc-b909-4794dae9c3ef None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:50:14.958252 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-5ae90a39-52cc-49dc-b909-4794dae9c3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:50:14.966559 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 571/1140] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 09:50:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:50:15.126928 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53259c9e-2dc8-470f-8ead-e4a631f3baa7 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:50:15.141826 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53259c9e-2dc8-470f-8ead-e4a631f3baa7 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:50:15.149339 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03554b81-0d91-4349-8671-b2c6c90e099f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:50:15.149941 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03554b81-0d91-4349-8671-b2c6c90e099f service nova] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:50:15.150211 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03554b81-0d91-4349-8671-b2c6c90e099f service nova] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:50:15.150481 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03554b81-0d91-4349-8671-b2c6c90e099f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:50:15.159305 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03554b81-0d91-4349-8671-b2c6c90e099f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:50:15.160908 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03554b81-0d91-4349-8671-b2c6c90e099f service nova] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:50:15.173711 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 570/1141] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:50:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:50:16.857766 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf46ce-5ab7-4f64-96a6-b322de2db8db None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:50:16.858633 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf46ce-5ab7-4f64-96a6-b322de2db8db None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:50:16.858633 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf46ce-5ab7-4f64-96a6-b322de2db8db None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:50:16.860560 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 572/1142] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 09:50:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:50:16.865770 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837a878-5b8e-4b04-b588-5d93fa24e818 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:50:16.866254 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837a878-5b8e-4b04-b588-5d93fa24e818 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:50:16.866369 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837a878-5b8e-4b04-b588-5d93fa24e818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:50:16.887457 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-3837a878-5b8e-4b04-b588-5d93fa24e818 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:50:16.888670 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-3837a878-5b8e-4b04-b588-5d93fa24e818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:50:16.898083 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 571/1143] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 09:50:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:50:17.057500 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf46ce-5ab7-4f64-96a6-b322de2db8db None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:50:17.073185 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf46ce-5ab7-4f64-96a6-b322de2db8db None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:50:17.078580 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0c4d7-f4a3-4cf0-903a-f50f478f900d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:50:17.079209 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0c4d7-f4a3-4cf0-903a-f50f478f900d service nova] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:50:17.079483 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0c4d7-f4a3-4cf0-903a-f50f478f900d service nova] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:50:17.079754 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0c4d7-f4a3-4cf0-903a-f50f478f900d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:50:17.088198 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0c4d7-f4a3-4cf0-903a-f50f478f900d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:50:17.089793 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0c4d7-f4a3-4cf0-903a-f50f478f900d service nova] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:50:17.099167 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 573/1144] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:50:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:50:21.477838 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dfbda-a94f-4e85-a1cb-2037667d96ce None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:50:21.478419 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dfbda-a94f-4e85-a1cb-2037667d96ce None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:50:21.478419 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dfbda-a94f-4e85-a1cb-2037667d96ce None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:50:21.479775 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 572/1145] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 09:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:50:21.485532 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bdfd1-99e6-4b4b-841a-bb446d10b8a2 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:50:21.486024 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bdfd1-99e6-4b4b-841a-bb446d10b8a2 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:50:21.486024 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bdfd1-99e6-4b4b-841a-bb446d10b8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:50:21.507324 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-747bdfd1-99e6-4b4b-841a-bb446d10b8a2 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:50:21.508857 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-747bdfd1-99e6-4b4b-841a-bb446d10b8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:50:21.518890 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 574/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 09:50:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:50:21.871000 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91dfbda-a94f-4e85-a1cb-2037667d96ce None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:50:21.872990 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-a91dfbda-a94f-4e85-a1cb-2037667d96ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:50:21.942035 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:50:21.949171 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91dfbda-a94f-4e85-a1cb-2037667d96ce None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:50:21.952987 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477be4df-a098-4ba6-a5a1-25209505f6a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:50:21.953586 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477be4df-a098-4ba6-a5a1-25209505f6a9 service neutron] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:50:21.953862 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477be4df-a098-4ba6-a5a1-25209505f6a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:50:21.954133 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477be4df-a098-4ba6-a5a1-25209505f6a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:50:21.964252 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477be4df-a098-4ba6-a5a1-25209505f6a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:50:21.965711 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477be4df-a098-4ba6-a5a1-25209505f6a9 service neutron] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:50:21.975940 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 573/1147] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:50:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:50:24.477856 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f631d5-1056-4a3f-bd78-d0881c2d89b5 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:50:24.478472 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f631d5-1056-4a3f-bd78-d0881c2d89b5 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:50:24.478472 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f631d5-1056-4a3f-bd78-d0881c2d89b5 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:50:24.479753 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 575/1148] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 09:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:50:24.485377 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796d287-3fb2-45e1-9c54-1d21873ac1d7 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:50:24.485834 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796d287-3fb2-45e1-9c54-1d21873ac1d7 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:50:24.485834 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796d287-3fb2-45e1-9c54-1d21873ac1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:50:24.506198 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-0796d287-3fb2-45e1-9c54-1d21873ac1d7 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:50:24.507445 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-0796d287-3fb2-45e1-9c54-1d21873ac1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:50:24.517120 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 574/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 09:50:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:50:24.857176 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f631d5-1056-4a3f-bd78-d0881c2d89b5 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:50:24.870185 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f631d5-1056-4a3f-bd78-d0881c2d89b5 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:50:24.874402 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f37274-e95f-4cf3-afdf-5bce9137b9b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:50:24.875076 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f37274-e95f-4cf3-afdf-5bce9137b9b6 service neutron] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:50:24.875350 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f37274-e95f-4cf3-afdf-5bce9137b9b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:50:24.875619 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f37274-e95f-4cf3-afdf-5bce9137b9b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:50:24.888036 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f37274-e95f-4cf3-afdf-5bce9137b9b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:50:24.889483 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f37274-e95f-4cf3-afdf-5bce9137b9b6 service neutron] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:50:24.900084 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 576/1150] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:50:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:50:28.873982 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c045ed0-8b52-4040-9678-5fe1058b7992 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:50:28.874508 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c045ed0-8b52-4040-9678-5fe1058b7992 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:50:28.874508 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c045ed0-8b52-4040-9678-5fe1058b7992 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:50:28.875898 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 575/1151] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 09:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:50:28.881629 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e6ea3-d74e-4f72-81d0-9452dd670060 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:50:28.882155 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e6ea3-d74e-4f72-81d0-9452dd670060 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:50:28.882155 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e6ea3-d74e-4f72-81d0-9452dd670060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:50:28.902407 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-3d7e6ea3-d74e-4f72-81d0-9452dd670060 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:50:28.903704 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-3d7e6ea3-d74e-4f72-81d0-9452dd670060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:50:28.912923 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 577/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 09:50:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:50:29.266647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c045ed0-8b52-4040-9678-5fe1058b7992 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:50:29.268466 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-3c045ed0-8b52-4040-9678-5fe1058b7992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:50:29.340555 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c045ed0-8b52-4040-9678-5fe1058b7992 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:50:29.344569 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ed276-a9a1-4145-a318-2d687ed58759 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25ffb8d1c3014daab3b00e2a059af76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:50:29.345163 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ed276-a9a1-4145-a318-2d687ed58759 service cinder] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:50:29.345436 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ed276-a9a1-4145-a318-2d687ed58759 service cinder] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:50:29.345702 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ed276-a9a1-4145-a318-2d687ed58759 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:50:29.355535 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ed276-a9a1-4145-a318-2d687ed58759 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:50:29.357013 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ed276-a9a1-4145-a318-2d687ed58759 service cinder] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:50:29.369820 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 576/1153] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:50:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:50:31.796216 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6a83d-312a-4acd-9144-1a2128fc3f73 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:50:31.797191 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6a83d-312a-4acd-9144-1a2128fc3f73 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:50:31.797191 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6a83d-312a-4acd-9144-1a2128fc3f73 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:50:31.798442 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 578/1154] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 09:50:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:50:31.804240 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15b219-9173-4779-83f7-619cac7a841b None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:50:31.804749 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15b219-9173-4779-83f7-619cac7a841b None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:50:31.804749 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15b219-9173-4779-83f7-619cac7a841b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:50:31.827150 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-6d15b219-9173-4779-83f7-619cac7a841b None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:50:31.828380 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-6d15b219-9173-4779-83f7-619cac7a841b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:50:31.838071 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 577/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 09:50:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:50:32.212762 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6a83d-312a-4acd-9144-1a2128fc3f73 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:50:32.214573 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-7ed6a83d-312a-4acd-9144-1a2128fc3f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:50:32.230504 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6a83d-312a-4acd-9144-1a2128fc3f73 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:50:32.234780 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0372342-5f62-477f-8fc6-46ded6c8a886 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25ffb8d1c3014daab3b00e2a059af76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:50:32.235407 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0372342-5f62-477f-8fc6-46ded6c8a886 service cinder] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:50:32.235685 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0372342-5f62-477f-8fc6-46ded6c8a886 service cinder] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:50:32.235952 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0372342-5f62-477f-8fc6-46ded6c8a886 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:50:32.245983 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0372342-5f62-477f-8fc6-46ded6c8a886 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:50:32.247494 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0372342-5f62-477f-8fc6-46ded6c8a886 service cinder] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:50:32.257733 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 579/1156] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:50:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:50:41.821042 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=42 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:50:42.253240 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=33 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:51:45.875027 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7cff7-79ca-4f7a-b165-4c7580b1d9d0 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:45.875729 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7cff7-79ca-4f7a-b165-4c7580b1d9d0 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:45.875729 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7cff7-79ca-4f7a-b165-4c7580b1d9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:45.891475 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d823cd6-d6a0-4dd4-a7d7-43569497c0c0 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:45.891475 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d823cd6-d6a0-4dd4-a7d7-43569497c0c0 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:45.891475 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d823cd6-d6a0-4dd4-a7d7-43569497c0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:45.897843 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-61b7cff7-79ca-4f7a-b165-4c7580b1d9d0 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:51:45.899105 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-61b7cff7-79ca-4f7a-b165-4c7580b1d9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:51:45.907396 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 578/1157] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 27 09:51:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:51:45.909877 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-2d823cd6-d6a0-4dd4-a7d7-43569497c0c0 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:51:45.911230 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-2d823cd6-d6a0-4dd4-a7d7-43569497c0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:51:45.915993 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab556634-5057-4075-a684-d5e6d63e3f95 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:45.916286 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab556634-5057-4075-a684-d5e6d63e3f95 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:45.916549 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab556634-5057-4075-a684-d5e6d63e3f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:45.919748 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 580/1158] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 27 09:51:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 09:51:45.928814 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb709b-f5f3-47c1-9c19-8a780412f109 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:45.929092 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb709b-f5f3-47c1-9c19-8a780412f109 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:45.929367 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb709b-f5f3-47c1-9c19-8a780412f109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:45.942449 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-ab556634-5057-4075-a684-d5e6d63e3f95 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:51:45.943910 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-ab556634-5057-4075-a684-d5e6d63e3f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:51:45.949501 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-43eb709b-f5f3-47c1-9c19-8a780412f109 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:51:45.950666 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-43eb709b-f5f3-47c1-9c19-8a780412f109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:51:45.952070 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 579/1159] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 27 09:51:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 09:51:45.957331 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab556634-5057-4075-a684-d5e6d63e3f95 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:51:45.958977 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 581/1160] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 27 09:51:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 09:51:45.963238 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb709b-f5f3-47c1-9c19-8a780412f109 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:51:45.967090 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab556634-5057-4075-a684-d5e6d63e3f95 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:51:45.972695 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9cb15-7f5f-498f-80d0-285349578f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:51:45.972981 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb709b-f5f3-47c1-9c19-8a780412f109 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:51:45.973305 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9cb15-7f5f-498f-80d0-285349578f95 admin admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:45.973578 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9cb15-7f5f-498f-80d0-285349578f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:45.973839 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9cb15-7f5f-498f-80d0-285349578f95 admin admin] PATH_INFO: `/v3/domains` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:45.974478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9cb15-7f5f-498f-80d0-285349578f95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:51:45.974789 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9cb15-7f5f-498f-80d0-285349578f95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:51:45.976430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9cb15-7f5f-498f-80d0-285349578f95 admin admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:51:45.977535 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294931ec-8998-482d-82ee-7a1622af5dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:51:45.978137 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294931ec-8998-482d-82ee-7a1622af5dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:45.978407 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294931ec-8998-482d-82ee-7a1622af5dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:45.978672 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294931ec-8998-482d-82ee-7a1622af5dc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:45.979338 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294931ec-8998-482d-82ee-7a1622af5dc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 09:51:45.979632 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294931ec-8998-482d-82ee-7a1622af5dc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:51:45.980632 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: WARNING py.warnings [None req-294931ec-8998-482d-82ee-7a1622af5dc2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 27 09:51:45.980632 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: warnings.warn(msg) Sep 27 09:51:45.980632 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: Sep 27 09:51:45.981503 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294931ec-8998-482d-82ee-7a1622af5dc2 admin admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:51:45.989518 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 580/1161] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 27 09:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 09:51:45.993366 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 582/1162] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Sep 27 09:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 09:51:45.997553 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9cb15-7f5f-498f-80d0-285349578f95 admin admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:51:46.001339 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294931ec-8998-482d-82ee-7a1622af5dc2 admin admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:51:46.007890 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9cb15-7f5f-498f-80d0-285349578f95 admin admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:51:46.011761 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294931ec-8998-482d-82ee-7a1622af5dc2 admin admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:51:46.012404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32969254-6783-455c-a081-57f90115b906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:51:46.013036 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32969254-6783-455c-a081-57f90115b906 admin admin] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:46.013316 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32969254-6783-455c-a081-57f90115b906 admin admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:46.013589 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32969254-6783-455c-a081-57f90115b906 admin admin] PATH_INFO: `/v3/projects` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:46.014218 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32969254-6783-455c-a081-57f90115b906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:51:46.015280 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: WARNING py.warnings [None req-32969254-6783-455c-a081-57f90115b906 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 09:51:46.015280 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: warnings.warn(msg) Sep 27 09:51:46.015280 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: Sep 27 09:51:46.016467 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32969254-6783-455c-a081-57f90115b906 admin admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:51:46.017012 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c37e7d-6273-42c2-850a-28ea08804caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:51:46.017938 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c37e7d-6273-42c2-850a-28ea08804caf admin admin] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:46.018244 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c37e7d-6273-42c2-850a-28ea08804caf admin admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:46.018573 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c37e7d-6273-42c2-850a-28ea08804caf admin admin] PATH_INFO: `/v3/projects` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:46.019171 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c37e7d-6273-42c2-850a-28ea08804caf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:51:46.021072 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c37e7d-6273-42c2-850a-28ea08804caf admin admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:51:46.047427 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 581/1163] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 27 09:51:45 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:51:46.052172 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32969254-6783-455c-a081-57f90115b906 admin admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:51:46.053108 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 583/1164] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 27 09:51:46 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:51:46.057167 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c37e7d-6273-42c2-850a-28ea08804caf admin admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:51:46.117647 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32969254-6783-455c-a081-57f90115b906 admin admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:51:46.119008 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c37e7d-6273-42c2-850a-28ea08804caf admin admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:51:46.122473 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aea3ff-26d2-495c-991b-d3507253e2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:51:46.123117 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aea3ff-26d2-495c-991b-d3507253e2a0 admin admin] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:46.123397 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aea3ff-26d2-495c-991b-d3507253e2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:46.123667 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aea3ff-26d2-495c-991b-d3507253e2a0 admin admin] PATH_INFO: `/v3/users` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:46.123832 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13dfc33-face-4ad4-b825-9f070c28c741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:51:46.124293 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aea3ff-26d2-495c-991b-d3507253e2a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:51:46.124443 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dfc33-face-4ad4-b825-9f070c28c741 admin admin] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:46.124718 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dfc33-face-4ad4-b825-9f070c28c741 admin admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:46.124990 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dfc33-face-4ad4-b825-9f070c28c741 admin admin] PATH_INFO: `/v3/users` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:46.125662 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13dfc33-face-4ad4-b825-9f070c28c741 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:51:46.126237 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aea3ff-26d2-495c-991b-d3507253e2a0 admin admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:51:46.126681 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: WARNING py.warnings [None req-a13dfc33-face-4ad4-b825-9f070c28c741 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 09:51:46.126681 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: warnings.warn(msg) Sep 27 09:51:46.126681 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: Sep 27 09:51:46.127910 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13dfc33-face-4ad4-b825-9f070c28c741 admin admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:51:46.150344 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 584/1165] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 27 09:51:46 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:51:46.154903 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 582/1166] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 27 09:51:46 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 09:51:46.155065 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13dfc33-face-4ad4-b825-9f070c28c741 admin admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:51:46.155906 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aea3ff-26d2-495c-991b-d3507253e2a0 admin admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:51:46.164954 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13dfc33-face-4ad4-b825-9f070c28c741 admin admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:51:46.165884 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aea3ff-26d2-495c-991b-d3507253e2a0 admin admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:51:46.169864 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80a944-09da-4318-8b58-d0a6382c13d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:51:46.170467 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80a944-09da-4318-8b58-d0a6382c13d4 admin admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:46.170585 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0049b-c991-4ba4-b76e-5ef88f3545eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:51:46.170743 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80a944-09da-4318-8b58-d0a6382c13d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:46.171041 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80a944-09da-4318-8b58-d0a6382c13d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:46.171209 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0049b-c991-4ba4-b76e-5ef88f3545eb admin admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:46.171488 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0049b-c991-4ba4-b76e-5ef88f3545eb admin admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:46.171690 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80a944-09da-4318-8b58-d0a6382c13d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:51:46.171804 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0049b-c991-4ba4-b76e-5ef88f3545eb admin admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:46.172381 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0049b-c991-4ba4-b76e-5ef88f3545eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:51:46.173679 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80a944-09da-4318-8b58-d0a6382c13d4 admin admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:51:46.174571 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0049b-c991-4ba4-b76e-5ef88f3545eb admin admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:51:46.184943 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 585/1167] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 27 09:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 09:51:46.191437 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 583/1168] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 27 09:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 09:51:46.192579 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0049b-c991-4ba4-b76e-5ef88f3545eb admin admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:51:46.192789 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80a944-09da-4318-8b58-d0a6382c13d4 admin admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:51:46.204060 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0049b-c991-4ba4-b76e-5ef88f3545eb admin admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:51:46.208763 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80a944-09da-4318-8b58-d0a6382c13d4 admin admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:51:46.209232 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2481f6c-9306-4896-ac4d-22e47b1b9c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:51:46.210033 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2481f6c-9306-4896-ac4d-22e47b1b9c3b admin admin] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:46.210544 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2481f6c-9306-4896-ac4d-22e47b1b9c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:46.211109 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2481f6c-9306-4896-ac4d-22e47b1b9c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:46.212273 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2481f6c-9306-4896-ac4d-22e47b1b9c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:51:46.214138 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99d667-b397-4470-8bf7-293d791f2f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:51:46.214794 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99d667-b397-4470-8bf7-293d791f2f9e admin admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:46.215208 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99d667-b397-4470-8bf7-293d791f2f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:46.215313 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2481f6c-9306-4896-ac4d-22e47b1b9c3b admin admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:51:46.215486 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99d667-b397-4470-8bf7-293d791f2f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:46.216130 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99d667-b397-4470-8bf7-293d791f2f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:51:46.217794 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99d667-b397-4470-8bf7-293d791f2f9e admin admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:51:46.226924 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 584/1169] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 27 09:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 09:51:46.233206 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2481f6c-9306-4896-ac4d-22e47b1b9c3b admin admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:51:46.233397 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 586/1170] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 27 09:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 09:51:46.235831 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99d667-b397-4470-8bf7-293d791f2f9e admin admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:51:46.242004 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2481f6c-9306-4896-ac4d-22e47b1b9c3b admin admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:51:46.246368 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99d667-b397-4470-8bf7-293d791f2f9e admin admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:51:46.250878 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f4881-f459-45c9-b0d2-c778346ea115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:51:46.251640 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f4881-f459-45c9-b0d2-c778346ea115 admin admin] REQUEST_METHOD: `PUT` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:46.252562 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f4881-f459-45c9-b0d2-c778346ea115 admin admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:46.252562 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f4881-f459-45c9-b0d2-c778346ea115 admin admin] PATH_INFO: `/v3/projects/a044325d92af4bbbab2c05504aca711c/users/97f7b5e8c5a449698d0f4fa318bde386/roles/378cb7fb6a4e4e5e89ab9a0ecb09d86b` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:46.253134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b099c24-757d-4e75-bea1-9bbdd945a5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:51:46.253797 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b099c24-757d-4e75-bea1-9bbdd945a5e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:46.254091 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b099c24-757d-4e75-bea1-9bbdd945a5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:46.254358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b099c24-757d-4e75-bea1-9bbdd945a5e0 admin admin] PATH_INFO: `/v3/projects/9dce4c8f39644b39a685d4b4379d6eea/users/007d0e4552f74e63983d78866ba845fb/roles/378cb7fb6a4e4e5e89ab9a0ecb09d86b` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:46.269389 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f4881-f459-45c9-b0d2-c778346ea115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a044325d92af4bbbab2c05504aca711c, user_id=97f7b5e8c5a449698d0f4fa318bde386, role_id=378cb7fb6a4e4e5e89ab9a0ecb09d86b)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:51:46.269949 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b099c24-757d-4e75-bea1-9bbdd945a5e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dce4c8f39644b39a685d4b4379d6eea, user_id=007d0e4552f74e63983d78866ba845fb, role_id=378cb7fb6a4e4e5e89ab9a0ecb09d86b)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:51:46.270433 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: WARNING py.warnings [None req-f63f4881-f459-45c9-b0d2-c778346ea115 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 09:51:46.270433 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: warnings.warn(msg) Sep 27 09:51:46.270433 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: Sep 27 09:51:46.272457 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f4881-f459-45c9-b0d2-c778346ea115 admin admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:51:46.272741 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b099c24-757d-4e75-bea1-9bbdd945a5e0 admin admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:51:46.291186 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 585/1172] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 27 09:51:46 2022] PUT /identity/v3/projects/a044325d92af4bbbab2c05504aca711c/users/97f7b5e8c5a449698d0f4fa318bde386/roles/378cb7fb6a4e4e5e89ab9a0ecb09d86b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 09:51:46.291379 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 587/1172] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 27 09:51:46 2022] PUT /identity/v3/projects/9dce4c8f39644b39a685d4b4379d6eea/users/007d0e4552f74e63983d78866ba845fb/roles/378cb7fb6a4e4e5e89ab9a0ecb09d86b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 09:51:46.296429 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bd521-9301-4843-b4ec-3b2558a72236 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:46.296750 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb79620-544e-4a20-8d6b-ef169ff27401 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:46.297068 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bd521-9301-4843-b4ec-3b2558a72236 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:46.297179 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb79620-544e-4a20-8d6b-ef169ff27401 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:46.297274 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bd521-9301-4843-b4ec-3b2558a72236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:46.297358 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb79620-544e-4a20-8d6b-ef169ff27401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:46.316751 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-9cb79620-544e-4a20-8d6b-ef169ff27401 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:51:46.317818 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-b31bd521-9301-4843-b4ec-3b2558a72236 None None] MFA Rules not processed for user `e6a28914e72f4ed6b89baeb8d519808a`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:51:46.317952 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-9cb79620-544e-4a20-8d6b-ef169ff27401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:51:46.322716 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-b31bd521-9301-4843-b4ec-3b2558a72236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:51:46.366832 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:51:46.369697 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:51:46.379736 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 586/1173] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 27 09:51:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:51:46.384327 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 588/1174] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 27 09:51:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 09:51:46.391076 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bd521-9301-4843-b4ec-3b2558a72236 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:51:46.396015 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb79620-544e-4a20-8d6b-ef169ff27401 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:51:46.397561 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-9cb79620-544e-4a20-8d6b-ef169ff27401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:51:46.450020 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bd521-9301-4843-b4ec-3b2558a72236 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:51:46.453621 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e7b75-bf4e-43e8-bf16-6c674fe2000a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:51:46.454226 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e7b75-bf4e-43e8-bf16-6c674fe2000a service neutron] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:46.454496 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e7b75-bf4e-43e8-bf16-6c674fe2000a service neutron] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:46.454859 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e7b75-bf4e-43e8-bf16-6c674fe2000a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:46.457431 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb79620-544e-4a20-8d6b-ef169ff27401 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:51:46.461196 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba422a-6f91-4d86-a134-107a4ff1a9ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:51:46.461808 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba422a-6f91-4d86-a134-107a4ff1a9ef service neutron] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:46.462083 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba422a-6f91-4d86-a134-107a4ff1a9ef service neutron] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:46.462349 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba422a-6f91-4d86-a134-107a4ff1a9ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:46.464299 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e7b75-bf4e-43e8-bf16-6c674fe2000a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:51:46.465753 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e7b75-bf4e-43e8-bf16-6c674fe2000a service neutron] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:51:46.472157 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba422a-6f91-4d86-a134-107a4ff1a9ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:51:46.473598 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba422a-6f91-4d86-a134-107a4ff1a9ef service neutron] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:51:46.475827 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 587/1175] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:51:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:51:46.483357 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 589/1176] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:51:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 09:51:51.968340 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b79b3-b7f6-4f2d-8fcb-32a42c7256c6 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:51.968993 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b79b3-b7f6-4f2d-8fcb-32a42c7256c6 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:51.969112 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b79b3-b7f6-4f2d-8fcb-32a42c7256c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:52.022480 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-b56b79b3-b7f6-4f2d-8fcb-32a42c7256c6 None None] MFA Rules not processed for user `007d0e4552f74e63983d78866ba845fb`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:51:52.023819 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-b56b79b3-b7f6-4f2d-8fcb-32a42c7256c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:51:52.145269 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 588/1177] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 27 09:51:51 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:51:52.146600 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba422a-6f91-4d86-a134-107a4ff1a9ef service neutron] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:51:52.164995 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba422a-6f91-4d86-a134-107a4ff1a9ef service neutron] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:51:52.177536 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f4630-2b1f-41f7-9e26-87a8798d8f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:51:52.178164 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f4630-2b1f-41f7-9e26-87a8798d8f28 admin admin] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:52.178439 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f4630-2b1f-41f7-9e26-87a8798d8f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:52.178710 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f4630-2b1f-41f7-9e26-87a8798d8f28 admin admin] PATH_INFO: `/v3/projects` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:52.179508 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f4630-2b1f-41f7-9e26-87a8798d8f28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:51:52.181481 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f4630-2b1f-41f7-9e26-87a8798d8f28 admin admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:51:52.220848 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c77dd6-704e-406a-838e-49c07902cd1c None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:52.221530 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c77dd6-704e-406a-838e-49c07902cd1c None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:52.222484 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c77dd6-704e-406a-838e-49c07902cd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:52.258133 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 590/1178] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 27 09:51:52 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:51:52.263450 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f4630-2b1f-41f7-9e26-87a8798d8f28 admin admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:51:52.267781 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-f3c77dd6-704e-406a-838e-49c07902cd1c None None] MFA Rules not processed for user `97f7b5e8c5a449698d0f4fa318bde386`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:51:52.269277 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-f3c77dd6-704e-406a-838e-49c07902cd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:51:52.363000 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f4630-2b1f-41f7-9e26-87a8798d8f28 admin admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:51:52.368623 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34452ff-19c3-4657-b480-ed34b8891c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:51:52.369185 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34452ff-19c3-4657-b480-ed34b8891c08 admin admin] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:52.369486 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34452ff-19c3-4657-b480-ed34b8891c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:52.369763 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34452ff-19c3-4657-b480-ed34b8891c08 admin admin] PATH_INFO: `/v3/users` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:52.370367 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34452ff-19c3-4657-b480-ed34b8891c08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:51:52.372355 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34452ff-19c3-4657-b480-ed34b8891c08 admin admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:51:52.401486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 589/1179] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 27 09:51:52 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:51:52.405838 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 591/1180] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 27 09:51:52 2022] POST /identity/v3/users => generated 299 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:51:52.409603 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c77dd6-704e-406a-838e-49c07902cd1c None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:51:52.412361 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34452ff-19c3-4657-b480-ed34b8891c08 admin admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:51:52.425048 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c77dd6-704e-406a-838e-49c07902cd1c None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:51:52.427461 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34452ff-19c3-4657-b480-ed34b8891c08 admin admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:51:52.430318 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90a19e-96ce-4b22-8956-d7998fb608d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:51:52.430757 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90a19e-96ce-4b22-8956-d7998fb608d8 admin admin] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:52.431255 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90a19e-96ce-4b22-8956-d7998fb608d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:52.431366 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90a19e-96ce-4b22-8956-d7998fb608d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:52.431971 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90a19e-96ce-4b22-8956-d7998fb608d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:51:52.434169 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90a19e-96ce-4b22-8956-d7998fb608d8 admin admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:51:52.436312 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337b2d6-fb43-4aa3-bfb0-d2ff2be53f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:51:52.437290 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337b2d6-fb43-4aa3-bfb0-d2ff2be53f54 admin admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:52.438236 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337b2d6-fb43-4aa3-bfb0-d2ff2be53f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:52.438742 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337b2d6-fb43-4aa3-bfb0-d2ff2be53f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:52.439988 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337b2d6-fb43-4aa3-bfb0-d2ff2be53f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:51:52.442506 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337b2d6-fb43-4aa3-bfb0-d2ff2be53f54 admin admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:51:52.463426 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 592/1181] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 27 09:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 09:51:52.471375 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:51:52.473111 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337b2d6-fb43-4aa3-bfb0-d2ff2be53f54 admin admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:51:52.494185 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337b2d6-fb43-4aa3-bfb0-d2ff2be53f54 admin admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:51:52.500083 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 590/1182] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Sep 27 09:51:52 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:51:52.501086 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b92e2-cb21-412a-9deb-beaf11a825a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:51:52.501883 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b92e2-cb21-412a-9deb-beaf11a825a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:52.502353 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b92e2-cb21-412a-9deb-beaf11a825a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:52.502455 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b92e2-cb21-412a-9deb-beaf11a825a9 admin admin] PATH_INFO: `/v3/projects/c3641ac3c3dc42d0997e1fa9ed4b8ef3/users/71c41ad18ab94e39b27993f7b15c1fb9/roles/7cc7d3c85c794033b590117321e97ccf` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:52.505152 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90a19e-96ce-4b22-8956-d7998fb608d8 admin admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:51:52.521529 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b92e2-cb21-412a-9deb-beaf11a825a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3641ac3c3dc42d0997e1fa9ed4b8ef3, user_id=71c41ad18ab94e39b27993f7b15c1fb9, role_id=7cc7d3c85c794033b590117321e97ccf)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:51:52.524409 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b92e2-cb21-412a-9deb-beaf11a825a9 admin admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:51:52.551428 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 593/1183] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 27 09:51:52 2022] PUT /identity/v3/projects/c3641ac3c3dc42d0997e1fa9ed4b8ef3/users/71c41ad18ab94e39b27993f7b15c1fb9/roles/7cc7d3c85c794033b590117321e97ccf => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 09:51:52.552723 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b92e2-cb21-412a-9deb-beaf11a825a9 admin admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:51:52.617525 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:51:52.625112 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90a19e-96ce-4b22-8956-d7998fb608d8 admin admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:51:52.656659 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b92e2-cb21-412a-9deb-beaf11a825a9 admin admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:51:52.662185 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cd58d-a4e4-4927-990a-894e456c9d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:51:52.663103 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cd58d-a4e4-4927-990a-894e456c9d5b admin admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:52.663387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cd58d-a4e4-4927-990a-894e456c9d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:52.663662 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cd58d-a4e4-4927-990a-894e456c9d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:52.664316 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79cd58d-a4e4-4927-990a-894e456c9d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:51:52.665949 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79cd58d-a4e4-4927-990a-894e456c9d5b admin admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:51:52.678661 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 594/1184] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 27 09:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 09:51:52.683344 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cd58d-a4e4-4927-990a-894e456c9d5b admin admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:51:52.699039 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cd58d-a4e4-4927-990a-894e456c9d5b admin admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:51:52.704608 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b106ab-a899-40cb-9e7c-8e3185cf4f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:51:52.705632 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b106ab-a899-40cb-9e7c-8e3185cf4f54 admin admin] REQUEST_METHOD: `PUT` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:52.705971 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b106ab-a899-40cb-9e7c-8e3185cf4f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:52.706248 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b106ab-a899-40cb-9e7c-8e3185cf4f54 admin admin] PATH_INFO: `/v3/projects/c3641ac3c3dc42d0997e1fa9ed4b8ef3/users/71c41ad18ab94e39b27993f7b15c1fb9/roles/7cc7d3c85c794033b590117321e97ccf` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:52.706792 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4b7ba-9954-448c-ac2b-f65766fa3dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:51:52.707725 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4b7ba-9954-448c-ac2b-f65766fa3dff admin admin] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:52.707963 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4b7ba-9954-448c-ac2b-f65766fa3dff admin admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:52.708304 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4b7ba-9954-448c-ac2b-f65766fa3dff admin admin] PATH_INFO: `/v3/users` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:52.708419 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b106ab-a899-40cb-9e7c-8e3185cf4f54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3641ac3c3dc42d0997e1fa9ed4b8ef3, user_id=71c41ad18ab94e39b27993f7b15c1fb9, role_id=7cc7d3c85c794033b590117321e97ccf)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:51:52.709071 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4b7ba-9954-448c-ac2b-f65766fa3dff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:51:52.711074 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b106ab-a899-40cb-9e7c-8e3185cf4f54 admin admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:51:52.711194 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4b7ba-9954-448c-ac2b-f65766fa3dff admin admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:51:52.733280 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 595/1185] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 27 09:51:52 2022] PUT /identity/v3/projects/c3641ac3c3dc42d0997e1fa9ed4b8ef3/users/71c41ad18ab94e39b27993f7b15c1fb9/roles/7cc7d3c85c794033b590117321e97ccf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 09:51:52.762820 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 591/1186] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Sep 27 09:51:52 2022] POST /identity/v3/users => generated 296 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 09:51:52.767888 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b106ab-a899-40cb-9e7c-8e3185cf4f54 admin admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:51:52.861761 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b106ab-a899-40cb-9e7c-8e3185cf4f54 admin admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:51:52.868576 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db178fac-9e0f-491d-981d-1bb666e436a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:51:52.868767 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db178fac-9e0f-491d-981d-1bb666e436a5 admin admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:52.869034 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db178fac-9e0f-491d-981d-1bb666e436a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:52.869309 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db178fac-9e0f-491d-981d-1bb666e436a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:52.870346 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db178fac-9e0f-491d-981d-1bb666e436a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:51:52.871696 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db178fac-9e0f-491d-981d-1bb666e436a5 admin admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:51:52.897422 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 596/1187] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 27 09:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 09:51:52.898436 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4b7ba-9954-448c-ac2b-f65766fa3dff admin admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:51:52.918664 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4b7ba-9954-448c-ac2b-f65766fa3dff admin admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:51:52.932687 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a0b40-42ec-4b83-a644-04a59e8905a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:51:52.943368 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a0b40-42ec-4b83-a644-04a59e8905a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:52.944006 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a0b40-42ec-4b83-a644-04a59e8905a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:52.944517 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a0b40-42ec-4b83-a644-04a59e8905a6 admin admin] PATH_INFO: `/v3/projects/3eab8841a85c45efb5e4d1f5ec04aa4d/users/35ceab9eda0a4d4493cb7a5d1dc72284/roles/7cc7d3c85c794033b590117321e97ccf` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:52.969936 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a0b40-42ec-4b83-a644-04a59e8905a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eab8841a85c45efb5e4d1f5ec04aa4d, user_id=35ceab9eda0a4d4493cb7a5d1dc72284, role_id=7cc7d3c85c794033b590117321e97ccf)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:51:52.973862 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a0b40-42ec-4b83-a644-04a59e8905a6 admin admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:51:53.002756 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 592/1188] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 27 09:51:52 2022] PUT /identity/v3/projects/3eab8841a85c45efb5e4d1f5ec04aa4d/users/35ceab9eda0a4d4493cb7a5d1dc72284/roles/7cc7d3c85c794033b590117321e97ccf => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 09:51:53.005983 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db178fac-9e0f-491d-981d-1bb666e436a5 admin admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:51:53.016563 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db178fac-9e0f-491d-981d-1bb666e436a5 admin admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:51:53.141083 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b9037-4478-4334-bcc2-b84c7d7a747a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:51:53.141745 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b9037-4478-4334-bcc2-b84c7d7a747a admin admin] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:53.142148 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b9037-4478-4334-bcc2-b84c7d7a747a admin admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:53.142582 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b9037-4478-4334-bcc2-b84c7d7a747a admin admin] PATH_INFO: `/v3/roles` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:53.143346 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b9037-4478-4334-bcc2-b84c7d7a747a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:51:53.145361 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b9037-4478-4334-bcc2-b84c7d7a747a admin admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:51:53.160500 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 597/1189] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Sep 27 09:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 09:51:53.164951 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a0b40-42ec-4b83-a644-04a59e8905a6 admin admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:51:53.188555 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a0b40-42ec-4b83-a644-04a59e8905a6 admin admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:51:53.203045 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edbb0b-cee7-44af-82ec-cefeb20b26b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:51:53.203685 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edbb0b-cee7-44af-82ec-cefeb20b26b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:53.204005 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edbb0b-cee7-44af-82ec-cefeb20b26b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:53.204413 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edbb0b-cee7-44af-82ec-cefeb20b26b3 admin admin] PATH_INFO: `/v3/projects/3eab8841a85c45efb5e4d1f5ec04aa4d/users/35ceab9eda0a4d4493cb7a5d1dc72284/roles/7cc7d3c85c794033b590117321e97ccf` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:53.213506 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edbb0b-cee7-44af-82ec-cefeb20b26b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eab8841a85c45efb5e4d1f5ec04aa4d, user_id=35ceab9eda0a4d4493cb7a5d1dc72284, role_id=7cc7d3c85c794033b590117321e97ccf)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:51:53.217395 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edbb0b-cee7-44af-82ec-cefeb20b26b3 admin admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:51:53.236078 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 593/1190] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Sep 27 09:51:53 2022] PUT /identity/v3/projects/3eab8841a85c45efb5e4d1f5ec04aa4d/users/35ceab9eda0a4d4493cb7a5d1dc72284/roles/7cc7d3c85c794033b590117321e97ccf => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 09:51:58.920687 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8768d-68b1-40f5-8aa3-913af4bc82eb None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:58.921226 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8768d-68b1-40f5-8aa3-913af4bc82eb None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:58.921226 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8768d-68b1-40f5-8aa3-913af4bc82eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:58.983854 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-a1e8768d-68b1-40f5-8aa3-913af4bc82eb None None] MFA Rules not processed for user `71c41ad18ab94e39b27993f7b15c1fb9`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:51:58.985601 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-a1e8768d-68b1-40f5-8aa3-913af4bc82eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:51:59.067860 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:51:59.181247 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 598/1191] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 27 09:51:58 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:51:59.205560 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edbb0b-cee7-44af-82ec-cefeb20b26b3 admin admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:51:59.207414 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-73edbb0b-cee7-44af-82ec-cefeb20b26b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:51:59.341110 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:51:59.362225 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edbb0b-cee7-44af-82ec-cefeb20b26b3 admin admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:51:59.378873 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b538801-5eb0-4faa-b85f-443d2db66fa3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1575d436c7d043d886293e24fa5f64fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:51:59.379429 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b538801-5eb0-4faa-b85f-443d2db66fa3 service glance] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:59.379702 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b538801-5eb0-4faa-b85f-443d2db66fa3 service glance] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:59.379969 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b538801-5eb0-4faa-b85f-443d2db66fa3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:59.473420 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033dc0f8-7b78-4afd-b66a-431e49e4412b None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:59.473952 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033dc0f8-7b78-4afd-b66a-431e49e4412b None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:59.474413 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033dc0f8-7b78-4afd-b66a-431e49e4412b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:59.478101 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b538801-5eb0-4faa-b85f-443d2db66fa3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:51:59.480780 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b538801-5eb0-4faa-b85f-443d2db66fa3 service glance] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:51:59.499442 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 594/1192] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:51:59 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:51:59.571441 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-033dc0f8-7b78-4afd-b66a-431e49e4412b None None] MFA Rules not processed for user `35ceab9eda0a4d4493cb7a5d1dc72284`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:51:59.573427 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-033dc0f8-7b78-4afd-b66a-431e49e4412b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:51:59.715650 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 599/1193] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 27 09:51:59 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:51:59.727703 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b538801-5eb0-4faa-b85f-443d2db66fa3 service glance] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:51:59.741436 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b538801-5eb0-4faa-b85f-443d2db66fa3 service glance] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:51:59.746210 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369ab54-8e28-4269-b6a3-ee1ec6d80031 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1575d436c7d043d886293e24fa5f64fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:51:59.746861 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369ab54-8e28-4269-b6a3-ee1ec6d80031 service glance] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:51:59.747146 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369ab54-8e28-4269-b6a3-ee1ec6d80031 service glance] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:51:59.747957 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369ab54-8e28-4269-b6a3-ee1ec6d80031 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:51:59.886020 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369ab54-8e28-4269-b6a3-ee1ec6d80031 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:51:59.887714 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369ab54-8e28-4269-b6a3-ee1ec6d80031 service glance] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:51:59.908114 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 595/1194] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:51:59 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:52:08.637753 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ba34d-487c-4482-a8e7-686d19c66cd0 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:52:08.638272 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ba34d-487c-4482-a8e7-686d19c66cd0 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:52:08.638374 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ba34d-487c-4482-a8e7-686d19c66cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:52:08.661531 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-6c6ba34d-487c-4482-a8e7-686d19c66cd0 None None] MFA Rules not processed for user `007d0e4552f74e63983d78866ba845fb`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:52:08.666679 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-6c6ba34d-487c-4482-a8e7-686d19c66cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:52:08.675239 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 600/1195] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 27 09:52:08 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:52:08.989449 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c38a82-73ac-408f-9a82-24f9a86d851d None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:52:08.990013 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c38a82-73ac-408f-9a82-24f9a86d851d None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:52:08.990189 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c38a82-73ac-408f-9a82-24f9a86d851d None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:52:08.991866 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 596/1196] 10.222.0.49 () {54 vars in 961 bytes} [Tue Sep 27 09:52:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:52:08.999941 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960449dc-3cd9-4bdb-a9b1-ce2ad9f13dcf None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:52:09.003050 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960449dc-3cd9-4bdb-a9b1-ce2ad9f13dcf None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:52:09.003618 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960449dc-3cd9-4bdb-a9b1-ce2ad9f13dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:52:09.025786 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-960449dc-3cd9-4bdb-a9b1-ce2ad9f13dcf None None] MFA Rules not processed for user `bda026ed208d4736938da05121a06f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:52:09.027050 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-960449dc-3cd9-4bdb-a9b1-ce2ad9f13dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:52:09.100581 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 601/1197] 10.222.0.49 () {58 vars in 1058 bytes} [Tue Sep 27 09:52:08 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:52:09.106095 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884765a-23cf-4397-9858-19dc3f6cb562 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:52:09.106364 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884765a-23cf-4397-9858-19dc3f6cb562 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:52:09.106652 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884765a-23cf-4397-9858-19dc3f6cb562 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:52:09.108031 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 597/1198] 10.222.0.49 () {54 vars in 912 bytes} [Tue Sep 27 09:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:52:09.113558 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae658c55-d56b-463d-95ee-b4bc3b586192 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:52:09.113844 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae658c55-d56b-463d-95ee-b4bc3b586192 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:52:09.114119 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae658c55-d56b-463d-95ee-b4bc3b586192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:52:09.135252 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-ae658c55-d56b-463d-95ee-b4bc3b586192 None None] MFA Rules not processed for user `bda026ed208d4736938da05121a06f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:52:09.136509 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-ae658c55-d56b-463d-95ee-b4bc3b586192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:52:09.146283 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 602/1199] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Sep 27 09:52:09 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:52:09.159006 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884765a-23cf-4397-9858-19dc3f6cb562 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:52:09.160821 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-6884765a-23cf-4397-9858-19dc3f6cb562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:52:09.177522 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884765a-23cf-4397-9858-19dc3f6cb562 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:52:09.182038 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d026528-291e-4db1-8d44-7e2bed673192 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1575d436c7d043d886293e24fa5f64fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:52:09.182936 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d026528-291e-4db1-8d44-7e2bed673192 service glance] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:52:09.183254 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d026528-291e-4db1-8d44-7e2bed673192 service glance] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:52:09.183579 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d026528-291e-4db1-8d44-7e2bed673192 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:52:09.197606 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d026528-291e-4db1-8d44-7e2bed673192 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:52:09.199376 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d026528-291e-4db1-8d44-7e2bed673192 service glance] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:52:09.212046 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 598/1200] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:52:09 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:52:09.705974 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f8439-a7d2-4936-bddb-471c56c2e3a1 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:52:09.706912 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f8439-a7d2-4936-bddb-471c56c2e3a1 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:52:09.706912 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f8439-a7d2-4936-bddb-471c56c2e3a1 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:52:09.707906 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 603/1201] 10.222.0.49 () {54 vars in 912 bytes} [Tue Sep 27 09:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:52:09.713991 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86daf19-a1de-4457-8d3b-ea6b1aa79057 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:52:09.714286 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86daf19-a1de-4457-8d3b-ea6b1aa79057 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:52:09.714547 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86daf19-a1de-4457-8d3b-ea6b1aa79057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:52:09.736074 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-e86daf19-a1de-4457-8d3b-ea6b1aa79057 None None] MFA Rules not processed for user `5a8283aa6cda48fa9a6b2f42fc498238`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:52:09.737486 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-e86daf19-a1de-4457-8d3b-ea6b1aa79057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:52:09.796145 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 599/1202] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Sep 27 09:52:09 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:52:09.809722 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f8439-a7d2-4936-bddb-471c56c2e3a1 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:52:09.824340 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f8439-a7d2-4936-bddb-471c56c2e3a1 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:52:09.828303 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2025f-9ad1-4b89-8d94-86fad93fd776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:52:09.828923 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2025f-9ad1-4b89-8d94-86fad93fd776 service neutron] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:52:09.829205 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2025f-9ad1-4b89-8d94-86fad93fd776 service neutron] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:52:09.829476 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2025f-9ad1-4b89-8d94-86fad93fd776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:52:09.838880 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2025f-9ad1-4b89-8d94-86fad93fd776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:52:09.840332 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2025f-9ad1-4b89-8d94-86fad93fd776 service neutron] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:52:09.854983 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 604/1203] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:52:09 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:52:10.297291 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57903365-2e1c-464c-b899-1af0a34d6764 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:52:10.297941 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57903365-2e1c-464c-b899-1af0a34d6764 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:52:10.297941 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57903365-2e1c-464c-b899-1af0a34d6764 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:52:10.300284 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 600/1204] 10.222.0.49 () {54 vars in 961 bytes} [Tue Sep 27 09:52:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:52:10.306589 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c104a8-2c84-4146-8bc8-369160ee8d87 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:52:10.306905 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c104a8-2c84-4146-8bc8-369160ee8d87 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:52:10.308079 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57903365-2e1c-464c-b899-1af0a34d6764 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:52:10.308724 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c104a8-2c84-4146-8bc8-369160ee8d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:52:10.334044 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-14c104a8-2c84-4146-8bc8-369160ee8d87 None None] MFA Rules not processed for user `bda026ed208d4736938da05121a06f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:52:10.335432 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-14c104a8-2c84-4146-8bc8-369160ee8d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:52:10.349706 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 605/1205] 10.222.0.49 () {58 vars in 1058 bytes} [Tue Sep 27 09:52:10 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:52:10.354929 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d1908-d06b-4e59-89d8-9e66204d5fb1 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:52:10.355205 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d1908-d06b-4e59-89d8-9e66204d5fb1 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:52:10.355476 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d1908-d06b-4e59-89d8-9e66204d5fb1 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:52:10.363133 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:52:10.364992 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 606/1206] 10.222.0.49 () {54 vars in 912 bytes} [Tue Sep 27 09:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 09:52:10.367776 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bea410-cf9a-4ee5-8659-4b83af790875 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:52:10.368232 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bea410-cf9a-4ee5-8659-4b83af790875 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:52:10.368721 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bea410-cf9a-4ee5-8659-4b83af790875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:52:10.415038 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57903365-2e1c-464c-b899-1af0a34d6764 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:52:10.417668 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-54bea410-cf9a-4ee5-8659-4b83af790875 None None] MFA Rules not processed for user `bda026ed208d4736938da05121a06f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:52:10.419282 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-54bea410-cf9a-4ee5-8659-4b83af790875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:52:10.421136 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1832b-eb96-4280-acc2-b7019418ac26 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d7d537583c64b5cabe287be6875a478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:52:10.422402 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1832b-eb96-4280-acc2-b7019418ac26 service placement] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:52:10.422963 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1832b-eb96-4280-acc2-b7019418ac26 service placement] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:52:10.423359 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1832b-eb96-4280-acc2-b7019418ac26 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:52:10.426468 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-eda1832b-eb96-4280-acc2-b7019418ac26 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:52:10.432269 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 607/1207] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Sep 27 09:52:10 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:52:10.441770 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1832b-eb96-4280-acc2-b7019418ac26 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:52:10.443611 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1832b-eb96-4280-acc2-b7019418ac26 service placement] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:52:10.447005 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bea410-cf9a-4ee5-8659-4b83af790875 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:52:10.457517 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 601/1208] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:52:10 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:52:10.464256 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bea410-cf9a-4ee5-8659-4b83af790875 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:52:10.470112 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d406b-5762-41c9-b564-bb5575a236cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:52:10.472079 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d406b-5762-41c9-b564-bb5575a236cc service neutron] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:52:10.472563 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d406b-5762-41c9-b564-bb5575a236cc service neutron] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:52:10.473004 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d406b-5762-41c9-b564-bb5575a236cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:52:10.486234 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d406b-5762-41c9-b564-bb5575a236cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:52:10.488901 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d406b-5762-41c9-b564-bb5575a236cc service neutron] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:52:10.496791 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=100 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:52:10.505089 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 608/1209] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:52:10 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:52:20.451601 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=17 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:52:23.320951 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a35175-aef9-4601-80bb-48cde02b583c None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:52:23.321643 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a35175-aef9-4601-80bb-48cde02b583c None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:52:23.321643 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a35175-aef9-4601-80bb-48cde02b583c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:52:23.342544 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-08a35175-aef9-4601-80bb-48cde02b583c None None] MFA Rules not processed for user `5a8283aa6cda48fa9a6b2f42fc498238`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:52:23.344085 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-08a35175-aef9-4601-80bb-48cde02b583c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:52:23.352507 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 602/1210] 10.222.0.62 () {58 vars in 1015 bytes} [Tue Sep 27 09:52:23 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:52:23.365813 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d406b-5762-41c9-b564-bb5575a236cc service neutron] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:52:23.376632 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d406b-5762-41c9-b564-bb5575a236cc service neutron] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:52:23.382085 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c342f4-466b-43bd-b575-2948613ac239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:52:23.382742 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c342f4-466b-43bd-b575-2948613ac239 service neutron] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:52:23.383064 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c342f4-466b-43bd-b575-2948613ac239 service neutron] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:52:23.383331 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c342f4-466b-43bd-b575-2948613ac239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:52:23.392287 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c342f4-466b-43bd-b575-2948613ac239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:52:23.393911 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c342f4-466b-43bd-b575-2948613ac239 service neutron] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:52:23.403070 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 609/1211] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:52:23 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:52:24.173336 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b419df7-7a39-492c-81e7-d22692cdefa1 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:52:24.173839 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b419df7-7a39-492c-81e7-d22692cdefa1 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:52:24.174632 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b419df7-7a39-492c-81e7-d22692cdefa1 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:52:24.176038 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 603/1212] 10.222.0.49 () {54 vars in 921 bytes} [Tue Sep 27 09:52:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:52:24.202401 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37069d-5fbd-4cab-9150-0fae438fbd88 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:52:24.202839 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37069d-5fbd-4cab-9150-0fae438fbd88 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:52:24.203003 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37069d-5fbd-4cab-9150-0fae438fbd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:52:24.224293 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-9c37069d-5fbd-4cab-9150-0fae438fbd88 None None] MFA Rules not processed for user `bda026ed208d4736938da05121a06f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:52:24.225666 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-9c37069d-5fbd-4cab-9150-0fae438fbd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:52:24.234592 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 610/1213] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Sep 27 09:52:24 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:52:24.263983 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b419df7-7a39-492c-81e7-d22692cdefa1 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:52:24.274753 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b419df7-7a39-492c-81e7-d22692cdefa1 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:52:24.280431 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0911d-889b-47c2-876c-1ceebd691442 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:52:24.281404 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0911d-889b-47c2-876c-1ceebd691442 service nova] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:52:24.281542 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0911d-889b-47c2-876c-1ceebd691442 service nova] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:52:24.281782 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0911d-889b-47c2-876c-1ceebd691442 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:52:24.296224 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0911d-889b-47c2-876c-1ceebd691442 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:52:24.298511 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0911d-889b-47c2-876c-1ceebd691442 service nova] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:52:24.310099 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 604/1214] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:52:24 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:52:32.293088 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240e797-7ef0-4ea8-b0e9-5b05f9e5e69f None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:52:32.293675 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240e797-7ef0-4ea8-b0e9-5b05f9e5e69f None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:52:32.293675 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240e797-7ef0-4ea8-b0e9-5b05f9e5e69f None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:52:32.295139 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 611/1215] 10.222.0.49 () {54 vars in 921 bytes} [Tue Sep 27 09:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:52:32.301666 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2444faa-8742-4e7d-b717-38744b182335 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:52:32.302211 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2444faa-8742-4e7d-b717-38744b182335 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:52:32.302945 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2444faa-8742-4e7d-b717-38744b182335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:52:32.329462 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-a2444faa-8742-4e7d-b717-38744b182335 None None] MFA Rules not processed for user `bda026ed208d4736938da05121a06f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:52:32.331090 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-a2444faa-8742-4e7d-b717-38744b182335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:52:32.340602 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 605/1216] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Sep 27 09:52:32 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:52:32.357963 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240e797-7ef0-4ea8-b0e9-5b05f9e5e69f None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:52:32.375782 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240e797-7ef0-4ea8-b0e9-5b05f9e5e69f None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:52:32.387299 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f314006-0bf8-4b3f-bc2a-982f5161cf0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:52:32.387935 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f314006-0bf8-4b3f-bc2a-982f5161cf0e service nova] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:52:32.388201 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f314006-0bf8-4b3f-bc2a-982f5161cf0e service nova] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:52:32.388574 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f314006-0bf8-4b3f-bc2a-982f5161cf0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:52:32.399387 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f314006-0bf8-4b3f-bc2a-982f5161cf0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:52:32.401015 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f314006-0bf8-4b3f-bc2a-982f5161cf0e service nova] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:52:32.411788 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 612/1217] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:52:32 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:52:42.327238 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=12 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:52:42.407062 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=15 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:52:46.853202 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2444faa-8742-4e7d-b717-38744b182335 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:52:46.864915 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2444faa-8742-4e7d-b717-38744b182335 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:52:46.868774 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22da666-7ef1-4656-9318-490db09eea8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:52:46.869393 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22da666-7ef1-4656-9318-490db09eea8d service neutron] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:52:46.869669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22da666-7ef1-4656-9318-490db09eea8d service neutron] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:52:46.869989 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22da666-7ef1-4656-9318-490db09eea8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:52:46.881227 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22da666-7ef1-4656-9318-490db09eea8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:52:46.882691 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22da666-7ef1-4656-9318-490db09eea8d service neutron] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:52:46.893252 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 606/1218] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:52:46 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:52:48.942624 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6218548-65b0-4660-8f80-204e37993211 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:52:48.943636 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6218548-65b0-4660-8f80-204e37993211 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:52:48.944114 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6218548-65b0-4660-8f80-204e37993211 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:52:48.946029 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 613/1219] 10.222.0.49 () {54 vars in 921 bytes} [Tue Sep 27 09:52:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 09:52:48.951434 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505b5a1-9ba5-4727-8cf6-bc620e1a91c1 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:52:48.951979 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505b5a1-9ba5-4727-8cf6-bc620e1a91c1 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:52:48.951979 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505b5a1-9ba5-4727-8cf6-bc620e1a91c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:52:48.972768 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-d505b5a1-9ba5-4727-8cf6-bc620e1a91c1 None None] MFA Rules not processed for user `bda026ed208d4736938da05121a06f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:52:48.974278 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-d505b5a1-9ba5-4727-8cf6-bc620e1a91c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:52:48.989008 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 607/1220] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Sep 27 09:52:48 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:52:49.009213 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6218548-65b0-4660-8f80-204e37993211 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:52:49.035414 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6218548-65b0-4660-8f80-204e37993211 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:52:49.044823 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f3a44-b2b7-4c9d-8adc-165916ade7e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:52:49.045826 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f3a44-b2b7-4c9d-8adc-165916ade7e0 service nova] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:52:49.046502 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f3a44-b2b7-4c9d-8adc-165916ade7e0 service nova] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:52:49.047016 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f3a44-b2b7-4c9d-8adc-165916ade7e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:52:49.060136 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f3a44-b2b7-4c9d-8adc-165916ade7e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:52:49.063062 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f3a44-b2b7-4c9d-8adc-165916ade7e0 service nova] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:52:49.082272 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 614/1221] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:52:49 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:52:58.967359 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=9 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:52:59.073700 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=6 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:53:01.275610 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260f473-4812-46b6-8032-a18bd200679c None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:53:01.276187 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260f473-4812-46b6-8032-a18bd200679c None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:53:01.276187 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260f473-4812-46b6-8032-a18bd200679c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:53:01.297083 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-b260f473-4812-46b6-8032-a18bd200679c None None] MFA Rules not processed for user `97f7b5e8c5a449698d0f4fa318bde386`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:53:01.298293 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-b260f473-4812-46b6-8032-a18bd200679c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:53:01.305854 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 608/1222] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 27 09:53:01 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:53:01.843296 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b068ff0-7dcc-46e0-93b8-97a483790d2d None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:53:01.843926 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b068ff0-7dcc-46e0-93b8-97a483790d2d None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:53:01.843926 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b068ff0-7dcc-46e0-93b8-97a483790d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:53:01.867990 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-2b068ff0-7dcc-46e0-93b8-97a483790d2d None None] MFA Rules not processed for user `5a8283aa6cda48fa9a6b2f42fc498238`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:53:01.869217 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-2b068ff0-7dcc-46e0-93b8-97a483790d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:53:01.877235 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 615/1223] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Sep 27 09:53:01 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:53:01.889772 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260f473-4812-46b6-8032-a18bd200679c None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:53:01.900081 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260f473-4812-46b6-8032-a18bd200679c None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:53:01.904020 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b7139-f8da-450b-ba5e-4db069ccce5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:53:01.904613 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b7139-f8da-450b-ba5e-4db069ccce5e service neutron] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:53:01.904962 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b7139-f8da-450b-ba5e-4db069ccce5e service neutron] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:53:01.905354 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b7139-f8da-450b-ba5e-4db069ccce5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:53:01.912766 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b7139-f8da-450b-ba5e-4db069ccce5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:53:01.914199 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b7139-f8da-450b-ba5e-4db069ccce5e service neutron] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:53:01.922518 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 609/1224] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:53:01 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:53:11.862041 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=3 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:53:11.918708 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=9 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:53:27.203202 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6e4d4-df82-496d-80f9-26e254888e1a None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:53:27.204230 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6e4d4-df82-496d-80f9-26e254888e1a None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:53:27.204230 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6e4d4-df82-496d-80f9-26e254888e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:53:27.228016 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-97e6e4d4-df82-496d-80f9-26e254888e1a None None] MFA Rules not processed for user `97f7b5e8c5a449698d0f4fa318bde386`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:53:27.229238 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-97e6e4d4-df82-496d-80f9-26e254888e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:53:27.237410 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 616/1225] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 27 09:53:27 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:53:37.222617 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=3 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:53:43.249019 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd967c2c-492d-42d2-95ba-f057bfa5a4d0 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:53:43.249552 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd967c2c-492d-42d2-95ba-f057bfa5a4d0 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:53:43.249552 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd967c2c-492d-42d2-95ba-f057bfa5a4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:53:43.279683 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-dd967c2c-492d-42d2-95ba-f057bfa5a4d0 None None] MFA Rules not processed for user `97f7b5e8c5a449698d0f4fa318bde386`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:53:43.280888 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-dd967c2c-492d-42d2-95ba-f057bfa5a4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:53:43.288341 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 610/1226] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 27 09:53:43 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:53:53.271666 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=3 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:54:43.582488 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01aedb-4ddd-44fb-b53d-94ae906f5e59 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:54:43.583090 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01aedb-4ddd-44fb-b53d-94ae906f5e59 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:54:43.583201 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01aedb-4ddd-44fb-b53d-94ae906f5e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:54:43.603908 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-8f01aedb-4ddd-44fb-b53d-94ae906f5e59 None None] MFA Rules not processed for user `97f7b5e8c5a449698d0f4fa318bde386`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:54:43.605135 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-8f01aedb-4ddd-44fb-b53d-94ae906f5e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:54:43.617775 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 617/1227] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 27 09:54:43 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:54:53.597663 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=3 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:54:57.809841 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd967c2c-492d-42d2-95ba-f057bfa5a4d0 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:54:57.830466 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd967c2c-492d-42d2-95ba-f057bfa5a4d0 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:54:57.834586 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72841642-fd29-4d5a-8651-7626d3deb2d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:54:57.835324 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72841642-fd29-4d5a-8651-7626d3deb2d1 service neutron] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:54:57.835491 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72841642-fd29-4d5a-8651-7626d3deb2d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:54:57.835781 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72841642-fd29-4d5a-8651-7626d3deb2d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:54:57.845550 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72841642-fd29-4d5a-8651-7626d3deb2d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:54:57.847052 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72841642-fd29-4d5a-8651-7626d3deb2d1 service neutron] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:54:57.857728 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 611/1228] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:54:57 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:55:07.852430 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=10 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:56:12.280791 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01aedb-4ddd-44fb-b53d-94ae906f5e59 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:56:12.304765 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01aedb-4ddd-44fb-b53d-94ae906f5e59 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:56:12.311841 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba62168-51a0-40c3-94cc-d97c78fccb1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d7d537583c64b5cabe287be6875a478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:56:12.312465 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba62168-51a0-40c3-94cc-d97c78fccb1f service placement] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:56:12.312739 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba62168-51a0-40c3-94cc-d97c78fccb1f service placement] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:56:12.313008 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba62168-51a0-40c3-94cc-d97c78fccb1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:56:12.322661 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba62168-51a0-40c3-94cc-d97c78fccb1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:56:12.324313 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba62168-51a0-40c3-94cc-d97c78fccb1f service placement] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:56:12.334928 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 618/1229] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:56:12 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:56:22.330485 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=10 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:57:05.350572 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72841642-fd29-4d5a-8651-7626d3deb2d1 service neutron] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:57:05.390379 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72841642-fd29-4d5a-8651-7626d3deb2d1 service neutron] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:57:05.399614 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a59661-1bb7-4c3c-87f5-f604c127c9ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:57:05.400665 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a59661-1bb7-4c3c-87f5-f604c127c9ee service nova] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:57:05.401156 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a59661-1bb7-4c3c-87f5-f604c127c9ee service nova] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:57:05.401680 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a59661-1bb7-4c3c-87f5-f604c127c9ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:57:05.416401 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a59661-1bb7-4c3c-87f5-f604c127c9ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:57:05.419525 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a59661-1bb7-4c3c-87f5-f604c127c9ee service nova] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:57:05.437468 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 612/1230] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:57:05 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:57:10.577912 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c492c-0393-4c8d-9e63-7573e3e82dda None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:57:10.578534 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c492c-0393-4c8d-9e63-7573e3e82dda None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:57:10.578534 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c492c-0393-4c8d-9e63-7573e3e82dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:57:10.601656 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-615c492c-0393-4c8d-9e63-7573e3e82dda None None] MFA Rules not processed for user `97f7b5e8c5a449698d0f4fa318bde386`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:57:10.603682 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-615c492c-0393-4c8d-9e63-7573e3e82dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:57:10.616337 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 619/1231] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 27 09:57:10 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:57:10.669539 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a59661-1bb7-4c3c-87f5-f604c127c9ee service nova] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:57:10.771322 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a59661-1bb7-4c3c-87f5-f604c127c9ee service nova] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:57:10.775713 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb507c3-14dd-4f86-ad3b-0b8a5fbfc564 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25ffb8d1c3014daab3b00e2a059af76b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:57:10.776258 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb507c3-14dd-4f86-ad3b-0b8a5fbfc564 service cinder] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:57:10.776669 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb507c3-14dd-4f86-ad3b-0b8a5fbfc564 service cinder] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:57:10.776941 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb507c3-14dd-4f86-ad3b-0b8a5fbfc564 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:57:10.789488 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb507c3-14dd-4f86-ad3b-0b8a5fbfc564 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:57:10.789974 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb507c3-14dd-4f86-ad3b-0b8a5fbfc564 service cinder] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:57:10.801965 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 613/1232] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:57:10 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 09:57:11.773590 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c492c-0393-4c8d-9e63-7573e3e82dda None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:57:11.788562 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb507c3-14dd-4f86-ad3b-0b8a5fbfc564 service cinder] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:57:11.791227 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c492c-0393-4c8d-9e63-7573e3e82dda None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:57:11.799783 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3899e-fd22-4584-b2ec-9780e28804b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d7d537583c64b5cabe287be6875a478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:57:11.800706 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3899e-fd22-4584-b2ec-9780e28804b0 service placement] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:57:11.801160 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3899e-fd22-4584-b2ec-9780e28804b0 service placement] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:57:11.801586 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3899e-fd22-4584-b2ec-9780e28804b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:57:11.804613 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb507c3-14dd-4f86-ad3b-0b8a5fbfc564 service cinder] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:57:11.811081 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03422387-b095-4556-b815-37cbc2c2a3f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:57:11.812106 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03422387-b095-4556-b815-37cbc2c2a3f5 service neutron] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:57:11.812538 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03422387-b095-4556-b815-37cbc2c2a3f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:57:11.812970 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03422387-b095-4556-b815-37cbc2c2a3f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:57:11.817926 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3899e-fd22-4584-b2ec-9780e28804b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:57:11.820539 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3899e-fd22-4584-b2ec-9780e28804b0 service placement] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:57:11.826688 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03422387-b095-4556-b815-37cbc2c2a3f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:57:11.828664 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03422387-b095-4556-b815-37cbc2c2a3f5 service neutron] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:57:11.833543 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 620/1233] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:57:11 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:57:11.843317 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 614/1234] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:57:11 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:57:21.828595 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=9 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:57:21.836881 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=46 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:57:22.880320 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3899e-fd22-4584-b2ec-9780e28804b0 service placement] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:57:22.894476 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3899e-fd22-4584-b2ec-9780e28804b0 service placement] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:57:22.900509 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd18ad2-d60d-4ce1-acd8-2bd6615dab57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:57:22.901140 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd18ad2-d60d-4ce1-acd8-2bd6615dab57 service nova] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:57:22.901692 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd18ad2-d60d-4ce1-acd8-2bd6615dab57 service nova] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:57:22.902104 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd18ad2-d60d-4ce1-acd8-2bd6615dab57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:57:22.911871 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd18ad2-d60d-4ce1-acd8-2bd6615dab57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:57:22.913509 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd18ad2-d60d-4ce1-acd8-2bd6615dab57 service nova] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:57:22.924597 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 621/1235] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:57:22 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:57:24.037761 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03422387-b095-4556-b815-37cbc2c2a3f5 service neutron] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:57:24.056160 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03422387-b095-4556-b815-37cbc2c2a3f5 service neutron] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:57:24.063431 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf01c1-fc47-480b-8dcd-5c42d3fffac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:57:24.064809 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf01c1-fc47-480b-8dcd-5c42d3fffac7 service neutron] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:57:24.065470 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf01c1-fc47-480b-8dcd-5c42d3fffac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:57:24.066100 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf01c1-fc47-480b-8dcd-5c42d3fffac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:57:24.081216 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf01c1-fc47-480b-8dcd-5c42d3fffac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:57:24.084102 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf01c1-fc47-480b-8dcd-5c42d3fffac7 service neutron] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:57:24.100761 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 615/1236] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:57:24 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:57:27.960217 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd18ad2-d60d-4ce1-acd8-2bd6615dab57 service nova] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:57:27.981503 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd18ad2-d60d-4ce1-acd8-2bd6615dab57 service nova] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:57:27.994305 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1664460-ba79-4c77-8eef-93061df6ed20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:57:27.995881 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1664460-ba79-4c77-8eef-93061df6ed20 service nova] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:57:27.996347 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1664460-ba79-4c77-8eef-93061df6ed20 service nova] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:57:27.997396 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1664460-ba79-4c77-8eef-93061df6ed20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:57:28.016520 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1664460-ba79-4c77-8eef-93061df6ed20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:57:28.019752 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1664460-ba79-4c77-8eef-93061df6ed20 service nova] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:57:28.041283 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 622/1237] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:57:27 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:57:34.094173 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=6 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:57:38.033337 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=12 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:57:41.347505 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d5a8c-d597-4fe7-9bd1-1c0dca67cb81 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:57:41.348147 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d5a8c-d597-4fe7-9bd1-1c0dca67cb81 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:57:41.348147 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d5a8c-d597-4fe7-9bd1-1c0dca67cb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:57:41.370929 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-9c5d5a8c-d597-4fe7-9bd1-1c0dca67cb81 None None] MFA Rules not processed for user `007d0e4552f74e63983d78866ba845fb`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:57:41.372276 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-9c5d5a8c-d597-4fe7-9bd1-1c0dca67cb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:57:41.380920 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 616/1238] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 27 09:57:41 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 09:57:51.364109 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=3 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:58:02.072009 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1664460-ba79-4c77-8eef-93061df6ed20 service nova] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:58:02.092352 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1664460-ba79-4c77-8eef-93061df6ed20 service nova] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:58:02.101628 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e237286-df06-4d3f-93bd-16793bbb6681 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:58:02.103026 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e237286-df06-4d3f-93bd-16793bbb6681 service nova] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:58:02.103827 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e237286-df06-4d3f-93bd-16793bbb6681 service nova] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:58:02.104793 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e237286-df06-4d3f-93bd-16793bbb6681 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:58:02.120663 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e237286-df06-4d3f-93bd-16793bbb6681 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:58:02.123315 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e237286-df06-4d3f-93bd-16793bbb6681 service nova] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:58:02.144997 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 623/1239] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:58:02 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 09:58:11.078996 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d5a8c-d597-4fe7-9bd1-1c0dca67cb81 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:58:11.090515 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d5a8c-d597-4fe7-9bd1-1c0dca67cb81 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:58:11.094720 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545544e-8283-4ce1-ab5e-c561e77de016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:58:11.095401 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545544e-8283-4ce1-ab5e-c561e77de016 service neutron] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:58:11.095652 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545544e-8283-4ce1-ab5e-c561e77de016 service neutron] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:58:11.095947 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545544e-8283-4ce1-ab5e-c561e77de016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:58:11.106488 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545544e-8283-4ce1-ab5e-c561e77de016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:58:11.108011 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545544e-8283-4ce1-ab5e-c561e77de016 service neutron] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:58:11.119357 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 617/1240] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:58:11 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:58:12.135808 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=6 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:58:15.547448 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e237286-df06-4d3f-93bd-16793bbb6681 service nova] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:58:15.593255 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e237286-df06-4d3f-93bd-16793bbb6681 service nova] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:58:15.615184 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d13ed7-1be2-4338-a22c-d3be9d0333c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda026ed208d4736938da05121a06f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:58:15.617007 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d13ed7-1be2-4338-a22c-d3be9d0333c9 service nova] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:58:15.617594 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d13ed7-1be2-4338-a22c-d3be9d0333c9 service nova] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:58:15.618146 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d13ed7-1be2-4338-a22c-d3be9d0333c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:58:15.638586 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d13ed7-1be2-4338-a22c-d3be9d0333c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:58:15.640645 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d13ed7-1be2-4338-a22c-d3be9d0333c9 service nova] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:58:15.654108 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 624/1241] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:58:15 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:58:21.114241 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=6 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:58:25.649117 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=6 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:59:23.515999 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab2773-caef-4caa-88d6-163078559dae None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:59:23.516678 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab2773-caef-4caa-88d6-163078559dae None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:59:23.516678 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab2773-caef-4caa-88d6-163078559dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:59:23.551197 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-68ab2773-caef-4caa-88d6-163078559dae None None] MFA Rules not processed for user `97f7b5e8c5a449698d0f4fa318bde386`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 09:59:23.552459 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-68ab2773-caef-4caa-88d6-163078559dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 09:59:23.583099 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 618/1242] 10.222.0.49 () {58 vars in 958 bytes} [Tue Sep 27 09:59:23 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 09:59:23.991815 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d13ed7-1be2-4338-a22c-d3be9d0333c9 service nova] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 09:59:24.019294 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d13ed7-1be2-4338-a22c-d3be9d0333c9 service nova] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 09:59:24.024252 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cf683-a84c-435e-b178-0abaf03ce180 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 09:59:24.024935 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cf683-a84c-435e-b178-0abaf03ce180 service neutron] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 09:59:24.025216 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cf683-a84c-435e-b178-0abaf03ce180 service neutron] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 09:59:24.025494 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cf683-a84c-435e-b178-0abaf03ce180 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 09:59:24.038656 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75cf683-a84c-435e-b178-0abaf03ce180 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 09:59:24.040250 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75cf683-a84c-435e-b178-0abaf03ce180 service neutron] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 09:59:24.060108 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 625/1243] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 09:59:23 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 09:59:33.579903 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=15 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 09:59:34.048434 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=11 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 10:00:44.675759 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab2773-caef-4caa-88d6-163078559dae None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 10:00:44.689717 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab2773-caef-4caa-88d6-163078559dae None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 10:00:44.693839 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769391ee-4e09-4774-9cbb-981f497ffbca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 10:00:44.694745 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769391ee-4e09-4774-9cbb-981f497ffbca service neutron] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 10:00:44.695299 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769391ee-4e09-4774-9cbb-981f497ffbca service neutron] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 10:00:44.695675 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769391ee-4e09-4774-9cbb-981f497ffbca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 10:00:44.811155 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769391ee-4e09-4774-9cbb-981f497ffbca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 10:00:44.812655 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769391ee-4e09-4774-9cbb-981f497ffbca service neutron] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 10:00:44.841081 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 619/1244] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 10:00:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 10:00:49.497356 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d9781-8804-4922-9ed2-688d7f180364 None None] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 10:00:49.497997 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d9781-8804-4922-9ed2-688d7f180364 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 10:00:49.497997 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d9781-8804-4922-9ed2-688d7f180364 None None] PATH_INFO: `/` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 10:00:49.499650 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 626/1245] 10.222.0.49 () {54 vars in 921 bytes} [Tue Sep 27 10:00:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 10:00:49.521975 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fdff2-e9eb-474b-8f0f-fdc779f3bf04 None None] REQUEST_METHOD: `POST` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 10:00:49.522603 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fdff2-e9eb-474b-8f0f-fdc779f3bf04 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 10:00:49.522880 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fdff2-e9eb-474b-8f0f-fdc779f3bf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 10:00:49.653142 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.auth.core [None req-bc3fdff2-e9eb-474b-8f0f-fdc779f3bf04 None None] MFA Rules not processed for user `8d7d537583c64b5cabe287be6875a478`. Rule list: `[]` (Enabled: `True`). {{(pid=99839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 10:00:49.654711 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-bc3fdff2-e9eb-474b-8f0f-fdc779f3bf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 10:00:49.687667 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 620/1246] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Sep 27 10:00:49 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 10:00:49.700856 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d9781-8804-4922-9ed2-688d7f180364 None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 10:00:49.703144 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-742d9781-8804-4922-9ed2-688d7f180364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 10:00:49.723000 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d9781-8804-4922-9ed2-688d7f180364 None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 10:00:49.730727 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e8956-600d-497a-8d2e-d54790f0741e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d7d537583c64b5cabe287be6875a478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 10:00:49.732175 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e8956-600d-497a-8d2e-d54790f0741e service placement] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 10:00:49.732883 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e8956-600d-497a-8d2e-d54790f0741e service placement] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 10:00:49.733361 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e8956-600d-497a-8d2e-d54790f0741e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 10:00:49.750113 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e8956-600d-497a-8d2e-d54790f0741e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 10:00:49.753445 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e8956-600d-497a-8d2e-d54790f0741e service placement] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 10:00:49.771806 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 627/1247] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 10:00:49 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 10:00:53.607435 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115bbb4-4aa9-43fa-97bd-980457a6b678 None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 10:00:53.608260 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115bbb4-4aa9-43fa-97bd-980457a6b678 None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 10:00:53.608260 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115bbb4-4aa9-43fa-97bd-980457a6b678 None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 10:00:53.609932 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 621/1248] 10.222.0.49 () {54 vars in 921 bytes} [Tue Sep 27 10:00:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 10:00:53.623717 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9130b1d-b816-4dfb-a97f-7d48021ed82a None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 10:00:53.624527 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9130b1d-b816-4dfb-a97f-7d48021ed82a None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 10:00:53.624527 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9130b1d-b816-4dfb-a97f-7d48021ed82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 10:00:53.656013 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-c9130b1d-b816-4dfb-a97f-7d48021ed82a None None] MFA Rules not processed for user `8d7d537583c64b5cabe287be6875a478`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 10:00:53.658111 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-c9130b1d-b816-4dfb-a97f-7d48021ed82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 10:00:53.673534 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 628/1249] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Sep 27 10:00:53 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 10:00:53.705432 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115bbb4-4aa9-43fa-97bd-980457a6b678 None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 10:00:53.728299 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9130b1d-b816-4dfb-a97f-7d48021ed82a None None] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 10:00:53.735704 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115bbb4-4aa9-43fa-97bd-980457a6b678 None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 10:00:53.744898 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec22ef-4b43-4e2e-bb1d-9dcf9bb27e1a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d7d537583c64b5cabe287be6875a478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 10:00:53.746111 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9130b1d-b816-4dfb-a97f-7d48021ed82a None None] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 10:00:53.746269 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec22ef-4b43-4e2e-bb1d-9dcf9bb27e1a service placement] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 10:00:53.746573 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec22ef-4b43-4e2e-bb1d-9dcf9bb27e1a service placement] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 10:00:53.747136 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec22ef-4b43-4e2e-bb1d-9dcf9bb27e1a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 10:00:53.752336 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff183494-9850-461d-98c8-5beeff857740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 10:00:53.753143 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff183494-9850-461d-98c8-5beeff857740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 10:00:53.753476 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff183494-9850-461d-98c8-5beeff857740 admin admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 10:00:53.753810 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff183494-9850-461d-98c8-5beeff857740 admin admin] PATH_INFO: `/v3/users/007d0e4552f74e63983d78866ba845fb` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 10:00:53.755201 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff183494-9850-461d-98c8-5beeff857740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=007d0e4552f74e63983d78866ba845fb)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 10:00:53.757510 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff183494-9850-461d-98c8-5beeff857740 admin admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 10:00:53.765039 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec22ef-4b43-4e2e-bb1d-9dcf9bb27e1a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 10:00:53.768218 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec22ef-4b43-4e2e-bb1d-9dcf9bb27e1a service placement] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 10:00:53.786871 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 622/1250] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 10:00:53 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 10:00:53.822662 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [None req-ff183494-9850-461d-98c8-5beeff857740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '007d0e4552f74e63983d78866ba845fb'} {{(pid=99838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:00:53.824138 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [None req-ff183494-9850-461d-98c8-5beeff857740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '007d0e4552f74e63983d78866ba845fb'} {{(pid=99838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:00:53.824313 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [None req-ff183494-9850-461d-98c8-5beeff857740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '007d0e4552f74e63983d78866ba845fb'} {{(pid=99838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:00:53.835334 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [None req-ff183494-9850-461d-98c8-5beeff857740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '007d0e4552f74e63983d78866ba845fb'} {{(pid=99838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:00:53.848595 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [None req-ff183494-9850-461d-98c8-5beeff857740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '007d0e4552f74e63983d78866ba845fb'} {{(pid=99838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:00:53.871286 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 629/1251] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 27 10:00:53 2022] DELETE /identity/v3/users/007d0e4552f74e63983d78866ba845fb => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 10:00:54.096003 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec22ef-4b43-4e2e-bb1d-9dcf9bb27e1a service placement] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 10:00:54.111473 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec22ef-4b43-4e2e-bb1d-9dcf9bb27e1a service placement] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 10:00:54.196555 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d0799-6ff1-49bb-b7f2-bfe574539936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 10:00:54.197231 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d0799-6ff1-49bb-b7f2-bfe574539936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 10:00:54.197507 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d0799-6ff1-49bb-b7f2-bfe574539936 admin admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 10:00:54.198189 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d0799-6ff1-49bb-b7f2-bfe574539936 admin admin] PATH_INFO: `/v3/projects/9dce4c8f39644b39a685d4b4379d6eea` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 10:00:54.199721 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d0799-6ff1-49bb-b7f2-bfe574539936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dce4c8f39644b39a685d4b4379d6eea)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 10:00:54.201824 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d0799-6ff1-49bb-b7f2-bfe574539936 admin admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 10:00:54.203645 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=100 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 10:00:54.266261 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [None req-dd8d0799-6ff1-49bb-b7f2-bfe574539936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dce4c8f39644b39a685d4b4379d6eea', 'request_id': 'req-dd8d0799-6ff1-49bb-b7f2-bfe574539936'} {{(pid=99839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:00:54.275955 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [None req-dd8d0799-6ff1-49bb-b7f2-bfe574539936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dce4c8f39644b39a685d4b4379d6eea', 'request_id': 'req-dd8d0799-6ff1-49bb-b7f2-bfe574539936'} {{(pid=99839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:00:54.285072 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [None req-dd8d0799-6ff1-49bb-b7f2-bfe574539936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dce4c8f39644b39a685d4b4379d6eea', 'request_id': 'req-dd8d0799-6ff1-49bb-b7f2-bfe574539936'} {{(pid=99839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:00:54.326004 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [None req-dd8d0799-6ff1-49bb-b7f2-bfe574539936 admin admin] The token cache is being invalidate because project 9dce4c8f39644b39a685d4b4379d6eea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 10:00:54.326495 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [None req-dd8d0799-6ff1-49bb-b7f2-bfe574539936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:00:54.327654 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [None req-dd8d0799-6ff1-49bb-b7f2-bfe574539936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:00:54.333857 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 623/1252] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 27 10:00:54 2022] DELETE /identity/v3/projects/9dce4c8f39644b39a685d4b4379d6eea => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 10:00:54.338241 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff183494-9850-461d-98c8-5beeff857740 admin admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 10:00:54.341043 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-ff183494-9850-461d-98c8-5beeff857740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 10:00:54.355641 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff183494-9850-461d-98c8-5beeff857740 admin admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 10:00:54.422898 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857272e-76b1-4078-801a-644082babed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 10:00:54.423676 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857272e-76b1-4078-801a-644082babed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 10:00:54.424058 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857272e-76b1-4078-801a-644082babed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 10:00:54.424422 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857272e-76b1-4078-801a-644082babed5 admin admin] PATH_INFO: `/v3/users/71c41ad18ab94e39b27993f7b15c1fb9` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 10:00:54.425778 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857272e-76b1-4078-801a-644082babed5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71c41ad18ab94e39b27993f7b15c1fb9)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 10:00:54.427832 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857272e-76b1-4078-801a-644082babed5 admin admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 10:00:54.497847 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [None req-a857272e-76b1-4078-801a-644082babed5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71c41ad18ab94e39b27993f7b15c1fb9'} {{(pid=99838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:00:54.498552 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [None req-a857272e-76b1-4078-801a-644082babed5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71c41ad18ab94e39b27993f7b15c1fb9'} {{(pid=99838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:00:54.499195 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [None req-a857272e-76b1-4078-801a-644082babed5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71c41ad18ab94e39b27993f7b15c1fb9'} {{(pid=99838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:00:54.505623 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 10:00:54.508499 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [None req-a857272e-76b1-4078-801a-644082babed5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71c41ad18ab94e39b27993f7b15c1fb9'} {{(pid=99838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:00:54.519678 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [None req-a857272e-76b1-4078-801a-644082babed5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71c41ad18ab94e39b27993f7b15c1fb9'} {{(pid=99838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:00:54.548087 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 630/1253] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 27 10:00:54 2022] DELETE /identity/v3/users/71c41ad18ab94e39b27993f7b15c1fb9 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 10:00:54.772762 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d0799-6ff1-49bb-b7f2-bfe574539936 admin admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 10:00:54.775328 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-dd8d0799-6ff1-49bb-b7f2-bfe574539936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 10:00:54.795145 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d0799-6ff1-49bb-b7f2-bfe574539936 admin admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 10:00:54.875783 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d529cf9-89f5-4a7c-bce6-b7e527f03177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 10:00:54.876478 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d529cf9-89f5-4a7c-bce6-b7e527f03177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 10:00:54.876836 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d529cf9-89f5-4a7c-bce6-b7e527f03177 admin admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 10:00:54.877258 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d529cf9-89f5-4a7c-bce6-b7e527f03177 admin admin] PATH_INFO: `/v3/projects/c3641ac3c3dc42d0997e1fa9ed4b8ef3` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 10:00:54.878672 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d529cf9-89f5-4a7c-bce6-b7e527f03177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3641ac3c3dc42d0997e1fa9ed4b8ef3)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 10:00:54.880789 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d529cf9-89f5-4a7c-bce6-b7e527f03177 admin admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 10:00:54.942301 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [None req-2d529cf9-89f5-4a7c-bce6-b7e527f03177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3641ac3c3dc42d0997e1fa9ed4b8ef3', 'request_id': 'req-2d529cf9-89f5-4a7c-bce6-b7e527f03177'} {{(pid=99839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:00:54.949417 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [None req-2d529cf9-89f5-4a7c-bce6-b7e527f03177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3641ac3c3dc42d0997e1fa9ed4b8ef3', 'request_id': 'req-2d529cf9-89f5-4a7c-bce6-b7e527f03177'} {{(pid=99839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:00:54.957188 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [None req-2d529cf9-89f5-4a7c-bce6-b7e527f03177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3641ac3c3dc42d0997e1fa9ed4b8ef3', 'request_id': 'req-2d529cf9-89f5-4a7c-bce6-b7e527f03177'} {{(pid=99839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:00:54.973921 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [None req-2d529cf9-89f5-4a7c-bce6-b7e527f03177 admin admin] The token cache is being invalidate because project c3641ac3c3dc42d0997e1fa9ed4b8ef3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 10:00:54.974350 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [None req-2d529cf9-89f5-4a7c-bce6-b7e527f03177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:00:54.975120 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [None req-2d529cf9-89f5-4a7c-bce6-b7e527f03177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:00:54.976887 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 624/1254] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 27 10:00:54 2022] DELETE /identity/v3/projects/c3641ac3c3dc42d0997e1fa9ed4b8ef3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 10:01:04.540397 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=9,keystone:INSERT=1,keystone:DELETE=3 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 10:01:04.970366 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=80,keystone:DELETE=14,keystone:INSERT=2 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 10:01:17.257320 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857272e-76b1-4078-801a-644082babed5 admin admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 10:01:17.258878 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-a857272e-76b1-4078-801a-644082babed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 10:01:17.341801 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857272e-76b1-4078-801a-644082babed5 admin admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 10:01:17.413757 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f47154-d039-498f-a9cb-31e25cd35087 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d7d537583c64b5cabe287be6875a478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 10:01:17.414465 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f47154-d039-498f-a9cb-31e25cd35087 service placement] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 10:01:17.414821 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f47154-d039-498f-a9cb-31e25cd35087 service placement] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 10:01:17.415151 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f47154-d039-498f-a9cb-31e25cd35087 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 10:01:17.417497 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-66f47154-d039-498f-a9cb-31e25cd35087 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 10:01:17.431357 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f47154-d039-498f-a9cb-31e25cd35087 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 10:01:17.433308 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f47154-d039-498f-a9cb-31e25cd35087 service placement] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 10:01:17.445034 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 631/1255] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 10:01:17 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 10:01:27.440160 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=58 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 10:02:03.746828 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d529cf9-89f5-4a7c-bce6-b7e527f03177 admin admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 10:02:03.748660 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-2d529cf9-89f5-4a7c-bce6-b7e527f03177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 10:02:03.861616 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d529cf9-89f5-4a7c-bce6-b7e527f03177 admin admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 10:02:03.867198 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f2c47-2cf8-4ab0-a247-f184d0d763d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 10:02:03.868105 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f2c47-2cf8-4ab0-a247-f184d0d763d4 service neutron] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 10:02:03.868514 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f2c47-2cf8-4ab0-a247-f184d0d763d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 10:02:03.868908 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f2c47-2cf8-4ab0-a247-f184d0d763d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 10:02:03.872427 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-414f2c47-2cf8-4ab0-a247-f184d0d763d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 10:02:04.024367 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f2c47-2cf8-4ab0-a247-f184d0d763d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 10:02:04.027559 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f2c47-2cf8-4ab0-a247-f184d0d763d4 service neutron] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 10:02:04.065106 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 625/1256] 10.222.0.49 () {60 vars in 1396 bytes} [Tue Sep 27 10:02:03 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 2814 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 10:02:09.515218 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f47154-d039-498f-a9cb-31e25cd35087 service placement] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 10:02:09.517147 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-66f47154-d039-498f-a9cb-31e25cd35087 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 10:02:09.531491 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f47154-d039-498f-a9cb-31e25cd35087 service placement] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 10:02:09.535377 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b8ac4-6834-449f-b0ce-b1d6c9d71ec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8283aa6cda48fa9a6b2f42fc498238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 10:02:09.536035 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b8ac4-6834-449f-b0ce-b1d6c9d71ec3 service neutron] REQUEST_METHOD: `GET` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 10:02:09.536309 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b8ac4-6834-449f-b0ce-b1d6c9d71ec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 10:02:09.536586 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b8ac4-6834-449f-b0ce-b1d6c9d71ec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 10:02:09.538903 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-db8b8ac4-6834-449f-b0ce-b1d6c9d71ec3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 10:02:09.641344 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b8ac4-6834-449f-b0ce-b1d6c9d71ec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 10:02:09.644137 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b8ac4-6834-449f-b0ce-b1d6c9d71ec3 service neutron] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 10:02:09.662515 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 632/1257] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 10:02:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 10:02:14.062298 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=66 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 10:02:18.055971 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f2c47-2cf8-4ab0-a247-f184d0d763d4 service neutron] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 10:02:18.059530 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-414f2c47-2cf8-4ab0-a247-f184d0d763d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 10:02:18.081942 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f2c47-2cf8-4ab0-a247-f184d0d763d4 service neutron] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 10:02:18.087291 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6dd0ec-d671-42b7-ad0c-5e9565cb1a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 10:02:18.087973 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dd0ec-d671-42b7-ad0c-5e9565cb1a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 10:02:18.088383 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dd0ec-d671-42b7-ad0c-5e9565cb1a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 10:02:18.088738 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dd0ec-d671-42b7-ad0c-5e9565cb1a65 admin admin] PATH_INFO: `/v3/users/97f7b5e8c5a449698d0f4fa318bde386` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 10:02:18.090150 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6dd0ec-d671-42b7-ad0c-5e9565cb1a65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97f7b5e8c5a449698d0f4fa318bde386)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 10:02:18.091467 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: WARNING py.warnings [None req-0d6dd0ec-d671-42b7-ad0c-5e9565cb1a65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 10:02:18.091467 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: warnings.warn(msg) Sep 27 10:02:18.091467 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: Sep 27 10:02:18.093334 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6dd0ec-d671-42b7-ad0c-5e9565cb1a65 admin admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 10:02:18.171563 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [None req-0d6dd0ec-d671-42b7-ad0c-5e9565cb1a65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97f7b5e8c5a449698d0f4fa318bde386'} {{(pid=99839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:02:18.172185 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [None req-0d6dd0ec-d671-42b7-ad0c-5e9565cb1a65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97f7b5e8c5a449698d0f4fa318bde386'} {{(pid=99839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:02:18.211501 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [None req-0d6dd0ec-d671-42b7-ad0c-5e9565cb1a65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97f7b5e8c5a449698d0f4fa318bde386'} {{(pid=99839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:02:18.233076 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [None req-0d6dd0ec-d671-42b7-ad0c-5e9565cb1a65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97f7b5e8c5a449698d0f4fa318bde386'} {{(pid=99839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:02:18.245968 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [None req-0d6dd0ec-d671-42b7-ad0c-5e9565cb1a65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97f7b5e8c5a449698d0f4fa318bde386'} {{(pid=99839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:02:18.253764 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 626/1258] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 27 10:02:18 2022] DELETE /identity/v3/users/97f7b5e8c5a449698d0f4fa318bde386 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 10:02:18.475622 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b8ac4-6834-449f-b0ce-b1d6c9d71ec3 service neutron] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 10:02:18.489432 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b8ac4-6834-449f-b0ce-b1d6c9d71ec3 service neutron] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 10:02:18.569822 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffaa86-2b1e-4729-9453-cace37bdd8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 10:02:18.570365 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffaa86-2b1e-4729-9453-cace37bdd8d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 10:02:18.570641 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffaa86-2b1e-4729-9453-cace37bdd8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 10:02:18.570950 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffaa86-2b1e-4729-9453-cace37bdd8d9 admin admin] PATH_INFO: `/v3/projects/a044325d92af4bbbab2c05504aca711c` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 10:02:18.572132 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ffaa86-2b1e-4729-9453-cace37bdd8d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a044325d92af4bbbab2c05504aca711c)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 10:02:18.573536 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: WARNING py.warnings [None req-11ffaa86-2b1e-4729-9453-cace37bdd8d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 10:02:18.573536 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: warnings.warn(msg) Sep 27 10:02:18.573536 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: Sep 27 10:02:18.575061 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ffaa86-2b1e-4729-9453-cace37bdd8d9 admin admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 10:02:18.648988 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [None req-11ffaa86-2b1e-4729-9453-cace37bdd8d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a044325d92af4bbbab2c05504aca711c', 'request_id': 'req-11ffaa86-2b1e-4729-9453-cace37bdd8d9'} {{(pid=99838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:02:18.660707 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [None req-11ffaa86-2b1e-4729-9453-cace37bdd8d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a044325d92af4bbbab2c05504aca711c', 'request_id': 'req-11ffaa86-2b1e-4729-9453-cace37bdd8d9'} {{(pid=99838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:02:18.676843 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [None req-11ffaa86-2b1e-4729-9453-cace37bdd8d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a044325d92af4bbbab2c05504aca711c', 'request_id': 'req-11ffaa86-2b1e-4729-9453-cace37bdd8d9'} {{(pid=99838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:02:18.692807 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [None req-11ffaa86-2b1e-4729-9453-cace37bdd8d9 admin admin] The token cache is being invalidate because project a044325d92af4bbbab2c05504aca711c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 10:02:18.693120 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [None req-11ffaa86-2b1e-4729-9453-cace37bdd8d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:02:18.693780 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [None req-11ffaa86-2b1e-4729-9453-cace37bdd8d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:02:18.695389 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 633/1259] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 27 10:02:18 2022] DELETE /identity/v3/projects/a044325d92af4bbbab2c05504aca711c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 10:02:18.701384 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6dd0ec-d671-42b7-ad0c-5e9565cb1a65 admin admin] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 10:02:18.702889 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-0d6dd0ec-d671-42b7-ad0c-5e9565cb1a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 10:02:18.717500 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6dd0ec-d671-42b7-ad0c-5e9565cb1a65 admin admin] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 10:02:18.780602 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493bd1c-b0ab-41fb-afda-67578ae40f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 10:02:18.781258 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493bd1c-b0ab-41fb-afda-67578ae40f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 10:02:18.781538 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493bd1c-b0ab-41fb-afda-67578ae40f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 10:02:18.781809 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493bd1c-b0ab-41fb-afda-67578ae40f08 admin admin] PATH_INFO: `/v3/users/35ceab9eda0a4d4493cb7a5d1dc72284` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 10:02:18.798459 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493bd1c-b0ab-41fb-afda-67578ae40f08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35ceab9eda0a4d4493cb7a5d1dc72284)` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 10:02:18.800524 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493bd1c-b0ab-41fb-afda-67578ae40f08 admin admin] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 10:02:18.859901 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [None req-8493bd1c-b0ab-41fb-afda-67578ae40f08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35ceab9eda0a4d4493cb7a5d1dc72284'} {{(pid=99839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:02:18.860705 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [None req-8493bd1c-b0ab-41fb-afda-67578ae40f08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35ceab9eda0a4d4493cb7a5d1dc72284'} {{(pid=99839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:02:18.877813 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 10:02:18.879841 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [None req-8493bd1c-b0ab-41fb-afda-67578ae40f08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35ceab9eda0a4d4493cb7a5d1dc72284'} {{(pid=99839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:02:18.889984 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [None req-8493bd1c-b0ab-41fb-afda-67578ae40f08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35ceab9eda0a4d4493cb7a5d1dc72284'} {{(pid=99839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:02:18.902523 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.notifications [None req-8493bd1c-b0ab-41fb-afda-67578ae40f08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35ceab9eda0a4d4493cb7a5d1dc72284'} {{(pid=99839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:02:18.909509 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 627/1260] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Sep 27 10:02:18 2022] DELETE /identity/v3/users/35ceab9eda0a4d4493cb7a5d1dc72284 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 10:02:19.130160 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffaa86-2b1e-4729-9453-cace37bdd8d9 admin admin] Authenticating user token {{(pid=99838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 10:02:19.132526 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-11ffaa86-2b1e-4729-9453-cace37bdd8d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 10:02:19.152933 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffaa86-2b1e-4729-9453-cace37bdd8d9 admin admin] Validating token access rules against request {{(pid=99838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 10:02:19.184066 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 10:02:19.233046 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb83458-d308-440d-9599-099d9243a72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6a28914e72f4ed6b89baeb8d519808a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dc269bfa7c47b5b3c652045ebe51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 10:02:19.233791 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb83458-d308-440d-9599-099d9243a72d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 10:02:19.234235 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb83458-d308-440d-9599-099d9243a72d admin admin] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 10:02:19.234503 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb83458-d308-440d-9599-099d9243a72d admin admin] PATH_INFO: `/v3/projects/3eab8841a85c45efb5e4d1f5ec04aa4d` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 10:02:19.249052 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb83458-d308-440d-9599-099d9243a72d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eab8841a85c45efb5e4d1f5ec04aa4d)` {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 10:02:19.251081 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb83458-d308-440d-9599-099d9243a72d admin admin] RBAC: Authorization granted {{(pid=99838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 10:02:19.310896 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [None req-2fb83458-d308-440d-9599-099d9243a72d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eab8841a85c45efb5e4d1f5ec04aa4d', 'request_id': 'req-2fb83458-d308-440d-9599-099d9243a72d'} {{(pid=99838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:02:19.318164 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [None req-2fb83458-d308-440d-9599-099d9243a72d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eab8841a85c45efb5e4d1f5ec04aa4d', 'request_id': 'req-2fb83458-d308-440d-9599-099d9243a72d'} {{(pid=99838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:02:19.326033 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [None req-2fb83458-d308-440d-9599-099d9243a72d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eab8841a85c45efb5e4d1f5ec04aa4d', 'request_id': 'req-2fb83458-d308-440d-9599-099d9243a72d'} {{(pid=99838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:02:19.341118 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [None req-2fb83458-d308-440d-9599-099d9243a72d admin admin] The token cache is being invalidate because project 3eab8841a85c45efb5e4d1f5ec04aa4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 10:02:19.341409 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [None req-2fb83458-d308-440d-9599-099d9243a72d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:02:19.342063 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.notifications [None req-2fb83458-d308-440d-9599-099d9243a72d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 10:02:19.343616 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 634/1261] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Sep 27 10:02:19 2022] DELETE /identity/v3/projects/3eab8841a85c45efb5e4d1f5ec04aa4d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 10:02:28.905699 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=7,keystone:INSERT=1,keystone:DELETE=1 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 10:02:29.337124 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 10:06:20.189078 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1f80f-22db-4f22-a957-4e1b306f796f None None] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 10:06:20.189945 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1f80f-22db-4f22-a957-4e1b306f796f None None] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 10:06:20.189945 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1f80f-22db-4f22-a957-4e1b306f796f None None] PATH_INFO: `/` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 10:06:20.191182 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 628/1262] 10.222.0.49 () {54 vars in 961 bytes} [Tue Sep 27 10:06:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 10:06:20.200305 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76705fb-bd6d-4470-a4e6-a68d34b3f495 None None] REQUEST_METHOD: `POST` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 10:06:20.200927 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76705fb-bd6d-4470-a4e6-a68d34b3f495 None None] SCRIPT_NAME: `/identity` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 10:06:20.201155 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76705fb-bd6d-4470-a4e6-a68d34b3f495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 10:06:20.232430 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.auth.core [None req-f76705fb-bd6d-4470-a4e6-a68d34b3f495 None None] MFA Rules not processed for user `8d7d537583c64b5cabe287be6875a478`. Rule list: `[]` (Enabled: `True`). {{(pid=99838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 10:06:20.234726 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG keystone.common.fernet_utils [None req-f76705fb-bd6d-4470-a4e6-a68d34b3f495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 10:06:20.344212 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: [pid: 99838|app: 0|req: 635/1263] 10.222.0.49 () {58 vars in 1058 bytes} [Tue Sep 27 10:06:20 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 10:06:20.353302 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1f80f-22db-4f22-a957-4e1b306f796f None None] Authenticating user token {{(pid=99839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 10:06:20.372388 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1f80f-22db-4f22-a957-4e1b306f796f None None] Validating token access rules against request {{(pid=99839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 10:06:20.378154 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16306e7b-da0a-40e0-ae57-fd8fde9ed6b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d7d537583c64b5cabe287be6875a478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbe5c492b05e40448942bb2500c185ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 10:06:20.378821 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16306e7b-da0a-40e0-ae57-fd8fde9ed6b9 service placement] REQUEST_METHOD: `GET` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 10:06:20.379106 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16306e7b-da0a-40e0-ae57-fd8fde9ed6b9 service placement] SCRIPT_NAME: `/identity` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 10:06:20.379377 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16306e7b-da0a-40e0-ae57-fd8fde9ed6b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 10:06:20.381334 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.fernet_utils [None req-16306e7b-da0a-40e0-ae57-fd8fde9ed6b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 10:06:20.405150 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16306e7b-da0a-40e0-ae57-fd8fde9ed6b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 10:06:20.407005 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16306e7b-da0a-40e0-ae57-fd8fde9ed6b9 service placement] RBAC: Authorization granted {{(pid=99839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 10:06:20.419297 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: [pid: 99839|app: 0|req: 629/1264] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Sep 27 10:06:20 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 10:06:30.340134 dv-osbrick-master-4-ceph devstack@keystone.service[99838]: DEBUG dbcounter [-] [99838] Writing DB stats keystone:SELECT=33 {{(pid=99838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 10:06:30.414058 dv-osbrick-master-4-ceph devstack@keystone.service[99839]: DEBUG dbcounter [-] [99839] Writing DB stats keystone:SELECT=6 {{(pid=99839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}